IEEE Trans Cybern. 2021 Dec;51(12):6319-6332. doi: 10.1109/TCYB.2020.2980815. Epub 2021 Dec 22.
Domain adaptation utilizes learned knowledge from an existing domain (source domain) to improve the classification performance of another related, but not identical, domain (target domain). Most existing domain adaptation methods first perform domain alignment, then apply standard classification algorithms. Transfer classifier induction is an emerging domain adaptation approach that incorporates the domain alignment into the process of building an adaptive classifier instead of using a standard classifier. Although transfer classifier induction approaches have achieved promising performance, they are mainly gradient-based approaches which can be trapped at local optima. In this article, we propose a transfer classifier induction algorithm based on evolutionary computation to address the above limitation. Specifically, a novel representation of the transfer classifier is proposed which has much lower dimensionality than the standard representation in existing transfer classifier induction approaches. We also propose a hybrid process to optimize two essential objectives in domain adaptation: 1) the manifold consistency and 2) the domain difference. Particularly, the manifold consistency is used in the main fitness function of the evolutionary search to preserve the intrinsic manifold structure of the data. The domain difference is reduced via a gradient-based local search applied to the top individuals generated by the evolutionary search. The experimental results show that the proposed algorithm can achieve better performance than seven state-of-the-art traditional domain adaptation algorithms and four state-of-the-art deep domain adaptation algorithms.
域自适应利用从现有域(源域)中学到的知识来提高另一个相关但不相同的域(目标域)的分类性能。大多数现有的域自适应方法首先进行域对齐,然后应用标准分类算法。迁移分类器归纳是一种新兴的域自适应方法,它将域对齐纳入自适应分类器的构建过程中,而不是使用标准分类器。虽然迁移分类器归纳方法已经取得了有希望的性能,但它们主要是基于梯度的方法,可能会陷入局部最优。在本文中,我们提出了一种基于进化计算的迁移分类器归纳算法来解决上述限制。具体来说,我们提出了一种新的迁移分类器表示方法,与现有迁移分类器归纳方法中的标准表示相比,该方法的维度要低得多。我们还提出了一种混合过程来优化域自适应中的两个基本目标:1)流形一致性和 2)域差异。特别是,流形一致性用于进化搜索的主要适应度函数中,以保留数据的内在流形结构。通过应用于进化搜索生成的顶级个体的基于梯度的局部搜索来减少域差异。实验结果表明,所提出的算法可以实现比七种最先进的传统域自适应算法和四种最先进的深度域自适应算法更好的性能。