Ma Ao, Li Jingjing, Lu Ke, Zhu Lei, Shen Heng Tao
IEEE Trans Neural Netw Learn Syst. 2022 Nov;33(11):6263-6274. doi: 10.1109/TNNLS.2021.3073119. Epub 2022 Oct 27.
Domain adaptation is proposed to deal with the challenging problem where the probability distribution of the training source is different from the testing target. Recently, adversarial learning has become the dominating technique for domain adaptation. Usually, adversarial domain adaptation methods simultaneously train a feature learner and a domain discriminator to learn domain-invariant features. Accordingly, how to effectively train the domain-adversarial model to learn domain-invariant features becomes a challenge in the community. To this end, we propose in this article a novel domain adaptation scheme named adversarial entropy optimization (AEO) to address the challenge. Specifically, we minimize the entropy when samples are from the independent distributions of source domain or target domain to improve the discriminability of the model. At the same time, we maximize the entropy when features are from the combined distribution of source domain and target domain so that the domain discriminator can be confused and the transferability of representations can be promoted. This minimax regime is well matched with the core idea of adversarial learning, empowering our model with transferability as well as discriminability for domain adaptation tasks. Also, AEO is flexible and compatible with different deep networks and domain adaptation frameworks. Experiments on five data sets show that our method can achieve state-of-the-art performance across diverse domain adaptation tasks.
领域适应旨在解决训练源的概率分布与测试目标不同这一具有挑战性的问题。近年来,对抗学习已成为领域适应的主导技术。通常,对抗领域适应方法同时训练一个特征学习器和一个领域判别器,以学习领域不变特征。因此,如何有效地训练领域对抗模型以学习领域不变特征成为该领域的一个挑战。为此,我们在本文中提出了一种名为对抗熵优化(AEO)的新型领域适应方案来应对这一挑战。具体而言,当样本来自源域或目标域的独立分布时,我们最小化熵以提高模型的可辨别性。同时,当特征来自源域和目标域的联合分布时,我们最大化熵,以便使领域判别器产生混淆并促进表示的可迁移性。这种极大极小机制与对抗学习的核心思想非常契合,使我们的模型在领域适应任务中兼具可迁移性和可辨别性。此外,AEO具有灵活性,可与不同的深度网络和领域适应框架兼容。在五个数据集上进行的实验表明,我们的方法在各种领域适应任务中都能取得领先的性能。