Fu Liyong, Li Zechao, Ye Qiaolin, Yin Hang, Liu Qingwang, Chen Xiaobo, Fan Xijian, Yang Wankou, Yang Guowei
IEEE Trans Neural Netw Learn Syst. 2022 Jan;33(1):130-144. doi: 10.1109/TNNLS.2020.3027588. Epub 2022 Jan 5.
Recently, there are many works on discriminant analysis, which promote the robustness of models against outliers by using L- or L-norm as the distance metric. However, both of their robustness and discriminant power are limited. In this article, we present a new robust discriminant subspace (RDS) learning method for feature extraction, with an objective function formulated in a different form. To guarantee the subspace to be robust and discriminative, we measure the within-class distances based on [Formula: see text]-norm and use [Formula: see text]-norm to measure the between-class distances. This also makes our method include rotational invariance. Since the proposed model involves both [Formula: see text]-norm maximization and [Formula: see text]-norm minimization, it is very challenging to solve. To address this problem, we present an efficient nongreedy iterative algorithm. Besides, motivated by trace ratio criterion, a mechanism of automatically balancing the contributions of different terms in our objective is found. RDS is very flexible, as it can be extended to other existing feature extraction techniques. An in-depth theoretical analysis of the algorithm's convergence is presented in this article. Experiments are conducted on several typical databases for image classification, and the promising results indicate the effectiveness of RDS.
最近,有许多关于判别分析的工作,它们通过使用L-或L-范数作为距离度量来提高模型对异常值的鲁棒性。然而,它们的鲁棒性和判别能力都有限。在本文中,我们提出了一种用于特征提取的新的鲁棒判别子空间(RDS)学习方法,其目标函数以不同的形式制定。为了保证子空间具有鲁棒性和判别性,我们基于[公式:见原文]-范数测量类内距离,并使用[公式:见原文]-范数测量类间距离。这也使我们的方法具有旋转不变性。由于所提出的模型涉及[公式:见原文]-范数最大化和[公式:见原文]-范数最小化,因此求解非常具有挑战性。为了解决这个问题,我们提出了一种高效的非贪婪迭代算法。此外,受迹比准则的启发,发现了一种自动平衡目标中不同项贡献的机制。RDS非常灵活,因为它可以扩展到其他现有的特征提取技术。本文对算法的收敛性进行了深入的理论分析。在几个用于图像分类的典型数据库上进行了实验,有前景的结果表明了RDS的有效性。