Suppr超能文献

通过拉格朗日对偶实现高效半定谱聚类。

Efficient semidefinite spectral clustering via lagrange duality.

出版信息

IEEE Trans Image Process. 2014 Aug;23(8):3522-34. doi: 10.1109/TIP.2014.2329453. Epub 2014 Jun 6.

Abstract

We propose an efficient approach to semidefinite spectral clustering (SSC), which addresses the Frobenius normalization with the positive semidefinite (p.s.d.) constraint for spectral clustering. Compared with the original Frobenius norm approximation-based algorithm, the proposed algorithm can more accurately find the closest doubly stochastic approximation to the affinity matrix by considering the p.s.d. constraint. In this paper, SSC is formulated as a semidefinite programming (SDP) problem. In order to solve the high computational complexity of SDP, we present a dual algorithm based on the Lagrange dual formalization. Two versions of the proposed algorithm are proffered: one with less memory usage and the other with faster convergence rate. The proposed algorithm has much lower time complexity than that of the standard interior-point-based SDP solvers. Experimental results on both the UCI data sets and real-world image data sets demonstrate that: 1) compared with the state-of-the-art spectral clustering methods, the proposed algorithm achieves better clustering performance and 2) our algorithm is much more efficient and can solve larger-scale SSC problems than those standard interior-point SDP solvers.

摘要

我们提出了一种有效的半定谱聚类(SSC)方法,该方法解决了谱聚类中 Frobenius 规范化与半正定(p.s.d.)约束的问题。与基于原始 Frobenius 范数逼近的算法相比,所提出的算法通过考虑 p.s.d. 约束,可以更准确地找到与相似矩阵最接近的双随机逼近。在本文中,SSC 被表述为一个半定规划(SDP)问题。为了解决 SDP 的高计算复杂度,我们提出了一种基于拉格朗日对偶形式化的对偶算法。提出了两种版本的算法:一种具有较少的内存使用,另一种具有更快的收敛速度。所提出的算法的时间复杂度比标准的内点 SDP 求解器低得多。在 UCI 数据集和真实世界图像数据集上的实验结果表明:1)与最先进的谱聚类方法相比,所提出的算法具有更好的聚类性能;2)我们的算法效率更高,可以解决比标准内点 SDP 求解器更大规模的 SSC 问题。

相似文献

1
Efficient semidefinite spectral clustering via lagrange duality.
IEEE Trans Image Process. 2014 Aug;23(8):3522-34. doi: 10.1109/TIP.2014.2329453. Epub 2014 Jun 6.
2
Efficient dual approach to distance metric learning.
IEEE Trans Neural Netw Learn Syst. 2014 Feb;25(2):394-406. doi: 10.1109/TNNLS.2013.2275170.
3
Worst case linear discriminant analysis as scalable semidefinite feasibility problems.
IEEE Trans Image Process. 2015 Aug;24(8):2382-92. doi: 10.1109/TIP.2015.2401511. Epub 2015 Feb 6.
4
Scalable Nonparametric Low-Rank Kernel Learning Using Block Coordinate Descent.
IEEE Trans Neural Netw Learn Syst. 2015 Sep;26(9):1927-38. doi: 10.1109/TNNLS.2014.2361159. Epub 2014 Oct 17.
5
Large-Scale Binary Quadratic Optimization Using Semidefinite Relaxation and Applications.
IEEE Trans Pattern Anal Mach Intell. 2017 Mar;39(3):470-485. doi: 10.1109/TPAMI.2016.2541146. Epub 2016 Mar 11.
6
Linear time maximum margin clustering.
IEEE Trans Neural Netw. 2010 Feb;21(2):319-32. doi: 10.1109/TNN.2009.2036998. Epub 2010 Jan 15.
7
Maximum margin clustering made practical.
IEEE Trans Neural Netw. 2009 Apr;20(4):583-96. doi: 10.1109/TNN.2008.2010620. Epub 2009 Mar 6.
9
Efficient l1 -norm-based low-rank matrix approximations for large-scale problems using alternating rectified gradient method.
IEEE Trans Neural Netw Learn Syst. 2015 Feb;26(2):237-51. doi: 10.1109/TNNLS.2014.2312535.
10
Large Scale Spectral Clustering Via Landmark-Based Sparse Representation.
IEEE Trans Cybern. 2015 Aug;45(8):1669-80. doi: 10.1109/TCYB.2014.2358564. Epub 2014 Sep 25.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验