IEEE Trans Pattern Anal Mach Intell. 2018 May;40(5):1182-1194. doi: 10.1109/TPAMI.2017.2656884. Epub 2017 Jan 23.
The capabilities of (I) learning transferable knowledge across domains; and (II) fine-tuning the pre-learned base knowledge towards tasks with considerably smaller data scale are extremely important. Many of the existing transfer learning techniques are supervised approaches, among which deep learning has the demonstrated power of learning domain transferrable knowledge with large scale network trained on massive amounts of labeled data. However, in many biomedical tasks, both the data and the corresponding label can be very limited, where the unsupervised transfer learning capability is urgently needed. In this paper, we proposed a novel multi-scale convolutional sparse coding (MSCSC) method, that (I) automatically learns filter banks at different scales in a joint fashion with enforced scale-specificity of learned patterns; and (II) provides an unsupervised solution for learning transferable base knowledge and fine-tuning it towards target tasks. Extensive experimental evaluation of MSCSC demonstrates the effectiveness of the proposed MSCSC in both regular and transfer learning tasks in various biomedical domains.
(I)跨领域学习可迁移知识的能力;和(II)针对数据规模小得多的任务调整预先学习的基础知识的能力,这两者极其重要。许多现有的迁移学习技术都是监督式方法,其中深度学习具有利用大规模网络在大量标记数据上训练学习领域可迁移知识的强大能力。然而,在许多生物医学任务中,数据和相应的标签都可能非常有限,因此迫切需要无监督的迁移学习能力。在本文中,我们提出了一种新颖的多尺度卷积稀疏编码(MSCSC)方法,它(I)以联合的方式自动学习不同尺度的滤波器组,并强制学习模式的尺度特异性;以及(II)提供了一种用于学习可迁移基础知识并针对目标任务进行调整的无监督解决方案。MSCSC 的广泛实验评估表明,该方法在各种生物医学领域的常规和迁移学习任务中均具有有效性。