School of Microelectronics, Tianjin University, Tianjin, China.
Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology, Tianjin, China.
Med Phys. 2022 Jun;49(6):3845-3859. doi: 10.1002/mp.15633. Epub 2022 Apr 18.
X-ray computed tomography (CT) has become a convenient and efficient clinical medical technique. However, in the presence of metal implants, CT images may be corrupted by metal artifacts. The metal artifact reduction (MAR) methods based on deep learning are mostly supervised methods trained with labeled synthetic-artifact CT images. However, this causes the neural network to be biased toward learning specific synthetic-artifact patterns and leads to a poor generalization for unlabeled real-artifact CT images. In this study, a semi-supervised learning method of latent features based on convolutional neural networks (SLF-CNN) is developed to remove metal artifacts while ensuring a good generalization ability for real-artifact CT images.
The proposed semi-supervised method extracts CT image features in alternate iterations of a synthetic-artifact learning stage and a real-artifact learning stage. In the synthetic-artifact learning stage, SLF-CNN is fed with paired synthetic-artifact CT images and is constrained using mean-squared-error (MSE) loss and perceptual loss in a supervised learning fashion. In the real-artifact learning stage, the network weight is updated by minimizing the error between the pseudo-ground truths and the predicted latent features. The feature level pseudo-ground truths are obtained by modeling latent features using the Gaussian process. The overall framework of SLF-CNN adopts an encoder-decoder structure. The encoder is composed of artifact information collection groups to map the input artifact-affected synthetic-artifact CT images and real-artifact CT images into latent features. The decoder is composed of stacked ResNeXt blocks and is responsible for decoding latent features with high-level semantic information to reconstruct artifact-free CT images. The performance of the proposed method is evaluated through contrast experiments and ablation experiments.
The contrast experimental results indicate that the artifact-free CT images obtained by SLF-CNN have good metrics values, which are close to or better than those of typical supervised MAR methods. The metal artifacts in artifact-affected CT images are eliminated and the tissue structure details are preserved using SLF-CNN. The ablation experiment shows that adding real-artifact CT images greatly improves the generalization ability of the network.
The proposed semi-supervised learning method of latent features for MAR effectively suppresses metal artifacts and improves the generalization ability of the network.
X 射线计算机断层扫描(CT)已成为一种便捷、高效的临床医疗技术。然而,在存在金属植入物的情况下,CT 图像可能会受到金属伪影的干扰。基于深度学习的金属伪影降低(MAR)方法大多是使用带标签的合成伪影 CT 图像进行训练的有监督方法。然而,这会导致神经网络偏向于学习特定的合成伪影模式,从而导致对未标记的真实伪影 CT 图像的泛化能力较差。在这项研究中,开发了一种基于卷积神经网络(SLF-CNN)的潜在特征的半监督学习方法,以在确保对真实伪影 CT 图像具有良好泛化能力的同时去除金属伪影。
所提出的半监督方法在合成伪影学习阶段和真实伪影学习阶段的交替迭代中提取 CT 图像特征。在合成伪影学习阶段,SLF-CNN 以成对的合成伪影 CT 图像为输入,并以均方误差(MSE)损失和感知损失的形式进行监督学习。在真实伪影学习阶段,通过最小化伪真实值和预测潜在特征之间的误差来更新网络权重。特征级伪真实值是通过使用高斯过程对潜在特征进行建模获得的。SLF-CNN 的整体框架采用编码器-解码器结构。编码器由收集伪影信息的组组成,用于将输入的受伪影影响的合成伪影 CT 图像和真实伪影 CT 图像映射到潜在特征中。解码器由堆叠的 ResNeXt 块组成,负责解码具有高级语义信息的潜在特征,以重建无伪影的 CT 图像。通过对比实验和消融实验来评估所提出方法的性能。
对比实验结果表明,SLF-CNN 获得的无伪影 CT 图像具有良好的指标值,接近或优于典型的有监督 MAR 方法。SLF-CNN 消除了受伪影影响的 CT 图像中的金属伪影,并保留了组织结构细节。消融实验表明,添加真实伪影 CT 图像大大提高了网络的泛化能力。
所提出的用于 MAR 的潜在特征的半监督学习方法可以有效地抑制金属伪影并提高网络的泛化能力。