Graves Kynan E, Nagarajah Romesh
Industrial Research Institute Swinburne, Faculty of Engineering and Industrial Sciences, Swinburne University of Technology, Hawthorn, Victoria 3122, Australia.
IEEE Trans Neural Netw. 2007 Jan;18(1):128-40. doi: 10.1109/TNN.2006.883012.
Uncertainty arises in classification problems when the input pattern is not perfect or measurement error is unavoidable. In many applications, it would be beneficial to obtain an estimate of the uncertainty associated with a new observation and its membership within a particular class. Although statistical classification techniques base decision boundaries according to the probability distributions of the patterns belonging to each class, they are poor at supplying uncertainty information for new observations. Previous research has documented a multiarchitecture, monotonic function neural network model for the representation of uncertainty associated with a new observation for two-class classification. This paper proposes a modification to the monotonic function model to estimate the uncertainty associated with a new observation for multiclass classification. The model, therefore, overcomes a limitation of traditional classifiers that base decisions on sharp classification boundaries. As such, it is believed that this method will have advantages for applications such as biometric recognition in which the estimation of classification uncertainty is an important issue. This approach is based on the transformation of the input pattern vector relative to each classification class. Separate, monotonic, single-output neural networks are then used to represent the "degree-of-similarity" between each input pattern vector and each class. An algorithm for the implementation of this approach is proposed and tested with publicly available face-recognition data sets. The results indicate that the suggested approach provides similar classification performance to conventional principle component analysis (PCA) and linear discriminant analysis (LDA) techniques for multiclass pattern recognition problems as well as providing uncertainty information caused by misclassification.
当输入模式不完美或测量误差不可避免时,分类问题中就会出现不确定性。在许多应用中,获得与新观测值及其在特定类别中的隶属度相关的不确定性估计将是有益的。尽管统计分类技术根据属于每个类别的模式的概率分布来确定决策边界,但它们在为新观测值提供不确定性信息方面表现不佳。先前的研究记录了一种多架构单调函数神经网络模型,用于表示与两类分类的新观测值相关的不确定性。本文提出了对单调函数模型的一种改进,以估计与多类分类的新观测值相关的不确定性。因此,该模型克服了传统分类器基于清晰分类边界进行决策的局限性。因此,人们认为这种方法将在诸如生物特征识别等应用中具有优势,在这些应用中,分类不确定性的估计是一个重要问题。这种方法基于相对于每个分类类别的输入模式向量的变换。然后使用单独的、单调的、单输出神经网络来表示每个输入模式向量与每个类之间的“相似度”。提出了一种实现该方法的算法,并使用公开可用的人脸识别数据集进行了测试。结果表明,对于多类模式识别问题,所提出的方法提供了与传统主成分分析(PCA)和线性判别分析(LDA)技术相似的分类性能,同时还提供了由错误分类引起的不确定性信息。