Tsinghua University, China.
Tsinghua Shenzhen International Graduate School, Tsinghua University, China.
Neural Netw. 2020 Nov;131:50-63. doi: 10.1016/j.neunet.2020.07.023. Epub 2020 Jul 25.
Image-to-image translation has drawn great attention during the past few years. It aims to translate an image in one domain to a target image in another domain. However, three big challenges remain in image-to-image translation: (1) the lack of large amounts of aligned training pairs for various tasks; (2) the ambiguity of multiple possible outputs from a single input image; and (3) the lack of simultaneous training for multi-domain translation with a single network. Therefore in this paper, we propose a unified framework for learning to generate diverse outputs using unpaired training data and allow for simultaneous multi-domain translation via a single model. Moreover, we also observed from experiments that the implicit disentanglement of content and style could lead to undesirable results. Thus we investigate how to extract domain-level signal as explicit supervision so as to achieve better image-to-image translation. Extensive experiments show that the proposed method outperforms or is comparable with the state-of-the-art methods for various applications.
图像到图像的翻译在过去几年中引起了广泛关注。它旨在将一个域中的图像转换为另一个域中的目标图像。然而，图像到图像的翻译仍然存在三个主要挑战：（1）缺乏各种任务的大量对齐训练对；（2）从单个输入图像中可能有多个可能的输出；（3）缺乏使用单个网络同时进行多域翻译的训练。因此，在本文中，我们提出了一个统一的框架，用于学习使用未配对的训练数据生成多样化的输出，并允许通过单个模型同时进行多域翻译。此外，我们还从实验中观察到，内容和风格的隐式解缠可能会导致不理想的结果。因此，我们研究了如何提取域级信号作为显式监督，以实现更好的图像到图像的翻译。广泛的实验表明，所提出的方法在各种应用中优于或可与最先进的方法相媲美。
