Peng Yong, Lu Bao-Liang, Wang Suhang
Center for Brain-like Computing and Machine Intelligence, Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
Center for Brain-like Computing and Machine Intelligence, Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China; Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
Neural Netw. 2015 May;65:1-17. doi: 10.1016/j.neunet.2015.01.001. Epub 2015 Jan 10.
Constructing an informative and discriminative graph plays an important role in various pattern recognition tasks such as clustering and classification. Among the existing graph-based learning models, low-rank representation (LRR) is a very competitive one, which has been extensively employed in spectral clustering and semi-supervised learning (SSL). In SSL, the graph is composed of both labeled and unlabeled samples, where the edge weights are calculated based on the LRR coefficients. However, most of existing LRR related approaches fail to consider the geometrical structure of data, which has been shown beneficial for discriminative tasks. In this paper, we propose an enhanced LRR via sparse manifold adaption, termed manifold low-rank representation (MLRR), to learn low-rank data representation. MLRR can explicitly take the data local manifold structure into consideration, which can be identified by the geometric sparsity idea; specifically, the local tangent space of each data point was sought by solving a sparse representation objective. Therefore, the graph to depict the relationship of data points can be built once the manifold information is obtained. We incorporate a regularizer into LRR to make the learned coefficients preserve the geometric constraints revealed in the data space. As a result, MLRR combines both the global information emphasized by low-rank property and the local information emphasized by the identified manifold structure. Extensive experimental results on semi-supervised classification tasks demonstrate that MLRR is an excellent method in comparison with several state-of-the-art graph construction approaches.
构建一个信息丰富且具有区分性的图在诸如聚类和分类等各种模式识别任务中起着重要作用。在现有的基于图的学习模型中,低秩表示(LRR)是一种非常有竞争力的模型,它已被广泛应用于谱聚类和半监督学习(SSL)。在SSL中,图由有标签和无标签的样本组成,其中边权重是基于LRR系数计算的。然而,大多数现有的与LRR相关的方法未能考虑数据的几何结构,而这已被证明对区分性任务有益。在本文中,我们通过稀疏流形自适应提出了一种增强的LRR,称为流形低秩表示(MLRR),以学习低秩数据表示。MLRR可以明确地考虑数据局部流形结构,这可以通过几何稀疏性思想来识别;具体来说,通过求解一个稀疏表示目标来寻求每个数据点的局部切空间。因此,一旦获得流形信息,就可以构建描绘数据点关系的图。我们在LRR中引入一个正则化项,以使学习到的系数保留数据空间中揭示的几何约束。结果,MLRR结合了由低秩性质强调的全局信息和由识别出的流形结构强调的局部信息。在半监督分类任务上的大量实验结果表明,与几种最先进的图构建方法相比,MLRR是一种优秀的方法。