Jing Taotao, Xia Haifeng, Hamm Jihun, Ding Zhengming
IEEE Trans Neural Netw Learn Syst. 2024 Sep;35(9):12459-12469. doi: 10.1109/TNNLS.2023.3263176. Epub 2024 Sep 3.
Domain adaptation (DA) has recently drawn a lot of attention, as it facilitates unlabeled target learning by borrowing knowledge from an external source domain. Most existing DA solutions seek to align feature representations between the labeled source and unlabeled target data. However, the scarcity of target data easily results in negative transfer, as it misleads the cross DA to the dominance of the source. To address the challenging few-shot domain adaptation (FSDA) problem, in this article, we propose a novel marginalized augmented FSDA (MAF) approach to address the cross-domain distribution disparity and insufficiency of target data simultaneously. On the one hand, cross-domain continuity augmentation (CCA) synthesizes abundant intermediate patterns across domains leading to a continuous domain-invariant latent space. On the other hand, sufficient source-supervised semantic augmentation (SSA) is explored to progressively diversify the conditional distribution within and across domains. Moreover, the proposed augmentation strategies are implemented efficiently via an expected transferable cross-entropy (CE) loss over the augmented distribution instead of explicit data synthesis, and minimizing the upper bound of the expected loss introduces negligible extra computing cost. Experimentally, our method outperforms the state of the art in various FSDA benchmarks, which demonstrates the effectiveness and contribution of our work. Our source code is provided at https://github.com/scottjingtt/MAF.git.
域适应(DA)近来备受关注,因为它通过借鉴外部源域的知识来促进无标签目标学习。大多数现有的域适应解决方案试图对齐有标签源数据和无标签目标数据之间的特征表示。然而,目标数据的稀缺容易导致负迁移,因为它会误导跨域适应偏向于源域的主导地位。为了解决具有挑战性的少样本域适应(FSDA)问题,在本文中,我们提出了一种新颖的边缘化增强FSDA(MAF)方法,以同时解决跨域分布差异和目标数据不足的问题。一方面,跨域连续性增强(CCA)在各域间合成丰富的中间模式,从而形成一个连续的域不变潜在空间。另一方面,探索充分的源监督语义增强(SSA)来逐步使域内和域间的条件分布多样化。此外,所提出的增强策略通过对增强分布的期望可转移交叉熵(CE)损失来高效实现,而非显式的数据合成,并且最小化期望损失的上界只会引入可忽略不计的额外计算成本。在实验中,我们的方法在各种FSDA基准测试中优于现有技术,这证明了我们工作的有效性和贡献。我们的源代码可在https://github.com/scottjingtt/MAF.git获取。