Department of Computer Science, Durham University, UK.
Department of Computer Science, Durham University, UK; Department of Engineering, Durham University, UK.
Neural Netw. 2023 Jun;163:40-52. doi: 10.1016/j.neunet.2023.03.033. Epub 2023 Mar 28.
Domain adaptation aims to exploit useful information from the source domain where annotated training data are easier to obtain to address a learning problem in the target domain where only limited or even no annotated data are available. In classification problems, domain adaptation has been studied under the assumption all classes are available in the target domain regardless of the annotations. However, a common situation where only a subset of classes in the target domain are available has not attracted much attention. In this paper, we formulate this particular domain adaptation problem within a generalized zero-shot learning framework by treating the labelled source-domain samples as semantic representations for zero-shot learning. For this novel problem, neither conventional domain adaptation approaches nor zero-shot learning algorithms directly apply. To solve this problem, we present a novel Coupled Conditional Variational Autoencoder (CCVAE) which can generate synthetic target-domain image features for unseen classes from real images in the source domain. Extensive experiments have been conducted on three domain adaptation datasets including a bespoke X-ray security checkpoint dataset to simulate a real-world application in aviation security. The results demonstrate the effectiveness of our proposed approach both against established benchmarks and in terms of real-world applicability.
域自适应旨在利用源域中易于获取的有标注训练数据的有用信息,解决目标域中有限甚至没有标注数据的学习问题。在分类问题中,域自适应在假设目标域中所有类都可用的情况下进行研究,而不考虑标注情况。然而,目标域中只有部分类可用的常见情况并没有引起太多关注。在本文中,我们通过将有标签的源域样本视为零样本学习的语义表示,在广义零样本学习框架内对这个特殊的域自适应问题进行了形式化。对于这个新问题,传统的域自适应方法和零样本学习算法都不能直接应用。为了解决这个问题,我们提出了一种新的耦合条件变分自动编码器(CCVAE),它可以从源域中的真实图像为未见类生成合成的目标域图像特征。我们在三个域自适应数据集上进行了广泛的实验,包括一个专门的 X 射线安全检查站数据集,以模拟航空安全中的实际应用。结果表明,我们提出的方法在与现有基准的比较以及实际应用方面都具有有效性。