Ding Zhengming, Fu Yun
IEEE Trans Neural Netw Learn Syst. 2019 Jun;30(6):1768-1779. doi: 10.1109/TNNLS.2018.2874567. Epub 2018 Oct 29.
Transfer learning has attracted great attention to facilitate the sparsely labeled or unlabeled target learning by leveraging previously well-established source domain through knowledge transfer. Recent activities on transfer learning attempt to build deep architectures to better fight off cross-domain divergences by extracting more effective features. However, its generalizability would decrease greatly due to the domain mismatch enlarges, particularly at the top layers. In this paper, we develop a novel deep transfer low-rank coding based on deep convolutional neural networks, where we investigate multilayer low-rank coding at the top task-specific layers. Specifically, multilayer common dictionaries shared across two domains are obtained to bridge the domain gap such that more enriched domain-invariant knowledge can be captured through a layerwise fashion. With rank minimization on the new codings, our model manages to preserve the global structures across source and target, and thus, similar samples of two domains tend to gather together for effective knowledge transfer. Furthermore, domain/classwise adaption terms are integrated to guide the effective coding optimization in a semisupervised manner, so the marginal and conditional disparities of two domains will be alleviated. Experimental results on three visual domain adaptation benchmarks verify the effectiveness of our proposed approach on boosting the recognition performance for the target domain, by comparing it with other state-of-the-art deep transfer learning.
迁移学习通过知识转移利用先前已充分建立的源域来促进稀疏标注或未标注的目标学习,已引起了极大关注。近期关于迁移学习的活动试图构建深度架构,通过提取更有效的特征来更好地抵御跨域差异。然而,由于域不匹配加剧,尤其是在顶层,其泛化能力会大幅下降。在本文中,我们基于深度卷积神经网络开发了一种新颖的深度迁移低秩编码方法,其中我们研究了顶层特定任务层的多层低秩编码。具体而言,通过跨两个域共享多层通用字典来弥合域差距,以便能够以分层方式捕获更丰富的域不变知识。通过对新编码进行秩最小化,我们的模型设法保留源域和目标域之间的全局结构,因此,两个域的相似样本倾向于聚集在一起以实现有效的知识转移。此外,整合了域/类自适应项以半监督方式指导有效的编码优化,从而减轻两个域的边际和条件差异。在三个视觉域适应基准上的实验结果通过与其他最新的深度迁移学习方法进行比较,验证了我们提出的方法在提高目标域识别性能方面的有效性。