Zhu Yongchun, Zhuang Fuzhen, Wang Jindong, Ke Guolin, Chen Jingwu, Bian Jiang, Xiong Hui, He Qing
IEEE Trans Neural Netw Learn Syst. 2021 Apr;32(4):1713-1722. doi: 10.1109/TNNLS.2020.2988928. Epub 2021 Apr 2.
For a target task where the labeled data are unavailable, domain adaptation can transfer a learner from a different source domain. Previous deep domain adaptation methods mainly learn a global domain shift, i.e., align the global source and target distributions without considering the relationships between two subdomains within the same category of different domains, leading to unsatisfying transfer learning performance without capturing the fine-grained information. Recently, more and more researchers pay attention to subdomain adaptation that focuses on accurately aligning the distributions of the relevant subdomains. However, most of them are adversarial methods that contain several loss functions and converge slowly. Based on this, we present a deep subdomain adaptation network (DSAN) that learns a transfer network by aligning the relevant subdomain distributions of domain-specific layer activations across different domains based on a local maximum mean discrepancy (LMMD). Our DSAN is very simple but effective, which does not need adversarial training and converges fast. The adaptation can be achieved easily with most feedforward network models by extending them with LMMD loss, which can be trained efficiently via backpropagation. Experiments demonstrate that DSAN can achieve remarkable results on both object recognition tasks and digit classification tasks. Our code will be available at https://github.com/easezyc/deep-transfer-learning.
对于标记数据不可用的目标任务,域适应可以将学习者从不同的源域进行迁移。以前的深度域适应方法主要学习全局域转移,即对齐全局源分布和目标分布,而不考虑不同域同一类别内两个子域之间的关系,导致在没有捕获细粒度信息的情况下迁移学习性能不尽人意。最近,越来越多的研究人员关注子域适应,其专注于精确对齐相关子域的分布。然而,其中大多数是包含多个损失函数且收敛缓慢的对抗方法。基于此,我们提出了一种深度子域适应网络(DSAN),它基于局部最大均值差异(LMMD),通过对齐不同域特定层激活的相关子域分布来学习迁移网络。我们的DSAN非常简单但有效,它不需要对抗训练且收敛速度快。通过用LMMD损失扩展大多数前馈网络模型,可以轻松实现适应,并且可以通过反向传播进行高效训练。实验表明,DSAN在目标识别任务和数字分类任务上都能取得显著成果。我们的代码将在https://github.com/easezyc/deep-transfer-learning上提供。