IEEE Trans Med Imaging. 2022 Nov;41(11):3357-3372. doi: 10.1109/TMI.2022.3184529. Epub 2022 Oct 27.
Optical coherence tomography (OCT) is a widely-used modality in clinical imaging, which suffers from the speckle noise inevitably. Deep learning has proven its superior capability in OCT image denoising, while the difficulty of acquiring a large number of well-registered OCT image pairs limits the developments of paired learning methods. To solve this problem, some unpaired learning methods have been proposed, where the denoising networks can be trained with unpaired OCT data. However, majority of them are modified from the cycleGAN framework. These cycleGAN-based methods train at least two generators and two discriminators, while only one generator is needed for the inference. The dual-generator and dual-discriminator structures of cycleGAN-based methods demand a large amount of computing resource, which may be redundant for OCT denoising tasks. In this work, we propose a novel triplet cross-fusion learning (TCFL) strategy for unpaired OCT image denoising. The model complexity of our strategy is much lower than those of the cycleGAN-based methods. During training, the clean components and the noise components from the triplet of three unpaired images are cross-fused, helping the network extract more speckle noise information to improve the denoising accuracy. Furthermore, the TCFL-based network which is trained with triplets can deal with limited training data scenarios. The results demonstrate that the TCFL strategy outperforms state-of-the-art unpaired methods both qualitatively and quantitatively, and even achieves denoising performance comparable with paired methods. Code is available at: https://github.com/gengmufeng/TCFL-OCT.
光学相干断层扫描 (OCT) 是临床成像中广泛使用的一种模态,不可避免地会受到散斑噪声的影响。深度学习已证明其在 OCT 图像去噪方面的优越性能,而获取大量配准良好的 OCT 图像对的难度限制了配对学习方法的发展。为了解决这个问题,已经提出了一些非配对学习方法,其中去噪网络可以使用非配对的 OCT 数据进行训练。然而,大多数方法都是从 cycleGAN 框架修改而来的。这些基于 cycleGAN 的方法至少训练两个生成器和两个判别器,而推断只需要一个生成器。基于 cycleGAN 的方法的双生成器和双判别器结构需要大量的计算资源,这对于 OCT 去噪任务可能是多余的。在这项工作中,我们提出了一种用于非配对 OCT 图像去噪的新的三重交叉融合学习 (TCFL) 策略。我们的策略的模型复杂度远低于基于 cycleGAN 的方法。在训练过程中,三个未配对图像对的干净分量和噪声分量进行交叉融合,帮助网络提取更多的散斑噪声信息,以提高去噪精度。此外,使用三重态训练的 TCFL 网络可以处理有限的训练数据场景。结果表明,TCFL 策略在定性和定量上都优于最新的非配对方法,甚至可以达到与配对方法相当的去噪性能。代码可在:https://github.com/gengmufeng/TCFL-OCT 获得。