College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou, 310027, China.
School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, 310018, China.
Neural Netw. 2023 Nov;168:518-530. doi: 10.1016/j.neunet.2023.10.002. Epub 2023 Oct 4.
Adversarial learning has proven to be an effective method for capturing transferable features for unsupervised domain adaptation. However, some existing conditional adversarial domain adaptation methods assign equal importance to different samples, ignoring the fact that hard-to-transfer samples might damage the conditional adversarial adaptation procedure. Meanwhile, some methods can only roughly align marginal distributions across domains, but cannot ensure category distributions alignment, causing classifiers to make uncertain or even wrong predictions for some target data. Furthermore, we find that the feature norms of real images usually follow a complex distribution, so directly matching the mean feature norms of two domains cannot effectively reduce the statistical discrepancy of feature norms and may potentially induce feature degradation. In this paper, we develop a Trust-aware Conditional Adversarial Domain Adaptation (TCADA) method for solving the aforementioned issues. To quantify data transferability, we suggest utilizing posterior probability modeled by a Gaussian-uniform mixture, which effectively facilitates conditional domain alignment. Based on this posterior probability, a confidence-guided alignment strategy is presented to promote precise alignment of category distributions and accelerate the learning of shared features. Moreover, a novel optimal transport-based strategy is introduced to align the feature norms and facilitate shared features becoming more informative. To encourage classifiers to make more accurate predictions for target data, we also design a mixed information-guided entropy regularization term to promote deep features being away from the decision boundaries. Extensive experiments show that our method greatly improves transfer performance on various tasks.
对抗学习已被证明是一种捕获无监督域自适应中可迁移特征的有效方法。然而,一些现有的条件对抗域自适应方法对不同的样本赋予相同的重要性,忽略了难以转移的样本可能会破坏条件对抗适应过程的事实。同时,一些方法只能大致对齐域间的边缘分布,但不能确保类别分布的对齐,导致分类器对一些目标数据做出不确定甚至错误的预测。此外,我们发现真实图像的特征范数通常遵循复杂的分布,因此直接匹配两个域的平均特征范数并不能有效地减少特征范数的统计差异,并且可能潜在地导致特征降级。在本文中,我们开发了一种信任感知的条件对抗域自适应(TCADA)方法来解决上述问题。为了量化数据的可转移性,我们建议利用高斯均匀混合模型建模的后验概率,这有效地促进了条件域对齐。基于这个后验概率,提出了一种置信引导的对齐策略,以促进类别分布的精确对齐和共享特征的学习。此外,引入了一种新的基于最优传输的策略来对齐特征范数,以促进共享特征变得更具信息量。为了鼓励分类器对目标数据做出更准确的预测,我们还设计了一个混合信息引导的熵正则化项,以促进深度特征远离决策边界。广泛的实验表明,我们的方法在各种任务上大大提高了迁移性能。