Tachibana Rie, Näppi Janne J, Hironaka Toru, Yoshida Hiroyuki
3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon Street, Suite 400C, Boston, MA 02114, USA.
Information Science & Technology Department, National Institute of Technology, Oshima College, 1091-1 Komatsu Suo-Oshima, Oshima, Yamaguchi 742-2193, Japan.
Cancers (Basel). 2022 Aug 26;14(17):4125. doi: 10.3390/cancers14174125.
Existing electronic cleansing (EC) methods for computed tomographic colonography (CTC) are generally based on image segmentation, which limits their accuracy to that of the underlying voxels. Because of the limitations of the available CTC datasets for training, traditional deep learning is of limited use in EC. The purpose of this study was to evaluate the technical feasibility of using a novel self-supervised adversarial learning scheme to perform EC with a limited training dataset with subvoxel accuracy. A three-dimensional (3D) generative adversarial network (3D GAN) was pre-trained to perform EC on CTC datasets of an anthropomorphic phantom. The 3D GAN was then fine-tuned to each input case by use of the self-supervised scheme. The architecture of the 3D GAN was optimized by use of a phantom study. The visually perceived quality of the virtual cleansing by the resulting 3D GAN compared favorably to that of commercial EC software on the virtual 3D fly-through examinations of 18 clinical CTC cases. Thus, the proposed self-supervised 3D GAN, which can be trained to perform EC on a small dataset without image annotations with subvoxel accuracy, is a potentially effective approach for addressing the remaining technical problems of EC in CTC.
现有的用于计算机断层结肠成像(CTC)的电子清洗(EC)方法通常基于图像分割,这将其准确性限制在基础体素的准确性上。由于用于训练的可用CTC数据集存在局限性,传统深度学习在EC中的应用有限。本研究的目的是评估使用一种新型自监督对抗学习方案在有限训练数据集上以亚体素精度执行EC的技术可行性。对一个三维(3D)生成对抗网络(3D GAN)进行预训练,以在拟人化体模的CTC数据集上执行EC。然后使用自监督方案对3D GAN针对每个输入病例进行微调。通过体模研究对3D GAN的架构进行了优化。在对18例临床CTC病例的虚拟3D飞行浏览检查中,所得3D GAN的虚拟清洗在视觉上感知到的质量与商业EC软件的质量相比具有优势。因此,所提出的自监督3D GAN可以在没有图像注释的小数据集上进行训练,以亚体素精度执行EC,是解决CTC中EC剩余技术问题的一种潜在有效方法。