Chen Yu, Xu Xiao-Hong
College of Science, South China Agricultural University, Guangzhou, Guangdong, 510642, China.
Neural Netw. 2014 Feb;50:33-46. doi: 10.1016/j.neunet.2013.10.006. Epub 2013 Nov 5.
In this paper, a new linear dimension reduction method called supervised orthogonal discriminant subspace projection (SODSP) is proposed, which addresses high-dimensionality of data and the small sample size problem. More specifically, given a set of data points in the ambient space, a novel weight matrix that describes the relationship between the data points is first built. And in order to model the manifold structure, the class information is incorporated into the weight matrix. Based on the novel weight matrix, the local scatter matrix as well as non-local scatter matrix is defined such that the neighborhood structure can be preserved. In order to enhance the recognition ability, we impose an orthogonal constraint into a graph-based maximum margin analysis, seeking to find a projection that maximizes the difference, rather than the ratio between the non-local scatter and the local scatter. In this way, SODSP naturally avoids the singularity problem. Further, we develop an efficient and stable algorithm for implementing SODSP, especially, on high-dimensional data set. Moreover, the theoretical analysis shows that LPP is a special instance of SODSP by imposing some constraints. Experiments on the ORL, Yale, Extended Yale face database B and FERET face database are performed to test and evaluate the proposed algorithm. The results demonstrate the effectiveness of SODSP.
本文提出了一种名为监督正交判别子空间投影(SODSP)的新的线性降维方法,该方法解决了数据的高维性和小样本量问题。具体而言,给定一组在环境空间中的数据点,首先构建一个描述数据点之间关系的新型权重矩阵。并且为了对流形结构进行建模,将类别信息纳入权重矩阵。基于该新型权重矩阵,定义局部散度矩阵以及非局部散度矩阵,以便能够保留邻域结构。为了提高识别能力,我们将正交约束引入基于图的最大间隔分析中,试图找到一个能使非局部散度与局部散度之间的差异最大化而非比率最大化的投影。通过这种方式,SODSP自然地避免了奇异性问题。此外,我们开发了一种高效且稳定的算法来实现SODSP,特别是在高维数据集上。而且,理论分析表明,通过施加一些约束,局部保留投影(LPP)是SODSP的一个特殊实例。在ORL、耶鲁、扩展耶鲁B人脸数据库和FERET人脸数据库上进行了实验,以测试和评估所提出的算法。结果证明了SODSP的有效性。