Zhang Lei, Gao Xinbo
IEEE Trans Neural Netw Learn Syst. 2022 Jun 21;PP. doi: 10.1109/TNNLS.2022.3183326.
The world we see is ever-changing and it always changes with people, things, and the environment. Domain is referred to as the state of the world at a certain moment. A research problem is characterized as transfer adaptation learning (TAL) when it needs knowledge correspondence between different moments/domains. TAL aims to build models that can perform tasks of target domain by learning knowledge from a semantic-related but distribution different source domain. It is an energetic research field of increasing influence and importance, which is presenting a blowout publication trend. This article surveys the advances of TAL methodologies in the past decade, and the technical challenges and essential problems of TAL have been observed and discussed with deep insights and new perspectives. Broader solutions of TAL being created by researchers are identified, i.e., instance reweighting adaptation, feature adaptation, classifier adaptation, deep network adaptation, and adversarial adaptation, which are beyond the early semisupervised and unsupervised split. The survey helps researchers rapidly but comprehensively understand and identify the research foundation, research status, theoretical limitations, future challenges, and understudied issues (universality, interpretability, and credibility) to be broken in the field toward generalizable representation in open-world scenarios.
我们所看到的世界是不断变化的,它总是随着人、事和环境而变化。领域被定义为世界在某一时刻的状态。当一个研究问题需要不同时刻/领域之间的知识对应时,它就被表征为迁移适应学习(TAL)。TAL旨在通过从语义相关但分布不同的源领域学习知识来构建能够执行目标领域任务的模型。它是一个影响力和重要性不断增加的活跃研究领域,呈现出井喷式的发表趋势。本文综述了过去十年中TAL方法的进展,并从深入的见解和新的视角观察和讨论了TAL的技术挑战和基本问题。识别出了研究人员正在创建的更广泛的TAL解决方案,即实例重新加权适应、特征适应、分类器适应、深度网络适应和对抗适应,这些超出了早期的半监督和无监督划分。该综述有助于研究人员快速而全面地理解和识别该领域的研究基础、研究现状、理论局限性、未来挑战以及有待突破的研究不足问题(通用性、可解释性和可信度),以实现开放世界场景中的可泛化表示。