IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):3396-3410. doi: 10.1109/TPAMI.2022.3179556. Epub 2023 Feb 3.
The low-rank tensor could characterize inner structure and explore high-order correlation among multi-view representations, which has been widely used in multi-view clustering. Existing approaches adopt the tensor nuclear norm (TNN) as a convex approximation of non-convex tensor rank function. However, TNN treats the different singular values equally and over-penalizes the main rank components, leading to sub-optimal tensor representation. In this paper, we devise a better surrogate of tensor rank, namely the tensor logarithmic Schatten- p norm ([Formula: see text]N), which fully considers the physical difference between singular values by the non-convex and non-linear penalty function. Further, a tensor logarithmic Schatten- p norm minimization ([Formula: see text]NM)-based multi-view subspace clustering ([Formula: see text]NM-MSC) model is proposed. Specially, the proposed [Formula: see text]NM can not only protect the larger singular values encoded with useful structural information, but also remove the smaller ones encoded with redundant information. Thus, the learned tensor representation with compact low-rank structure will well explore the complementary information and accurately characterize the high-order correlation among multi-views. The alternating direction method of multipliers (ADMM) is used to solve the non-convex multi-block [Formula: see text]NM-MSC model where the challenging [Formula: see text]NM problem is carefully handled. Importantly, the algorithm convergence analysis is mathematically established by showing that the sequence generated by the algorithm is of Cauchy and converges to a Karush-Kuhn-Tucker (KKT) point. Experimental results on nine benchmark databases reveal the superiority of the [Formula: see text]NM-MSC model.
低秩张量可以刻画内在结构,并探索多视图表示之间的高阶相关性,这在多视图聚类中得到了广泛的应用。现有的方法采用张量核范数(TNN)作为非凸张量秩函数的凸逼近。然而,TNN 平等对待不同的奇异值,并过度惩罚主要的秩分量,导致次优的张量表示。在本文中,我们设计了一个更好的张量秩的替代物,即张量对数 Schatten-p 范数([Formula: see text]N),它通过非凸和非线性惩罚函数充分考虑了奇异值之间的物理差异。进一步,提出了一种基于张量对数 Schatten-p 范数最小化([Formula: see text]NM)的多视图子空间聚类([Formula: see text]NM-MSC)模型。特别地,所提出的[Formula: see text]NM 不仅可以保护编码有用结构信息的较大奇异值,还可以去除编码冗余信息的较小奇异值。因此,学习到的具有紧凑低秩结构的张量表示可以很好地探索互补信息,并准确刻画多视图之间的高阶相关性。利用增广拉格朗日乘子法(ADMM)来求解非凸多块[Formula: see text]NM-MSC 模型,其中对具有挑战性的[Formula: see text]NM 问题进行了仔细处理。重要的是,通过证明算法产生的序列是柯西序列并收敛到卡拉什-库恩-塔克(KKT)点,从数学上建立了算法的收敛性分析。在九个基准数据库上的实验结果表明了[Formula: see text]NM-MSC 模型的优越性。