Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, California, USA.
Biomedical Physics Inter-Departmental Graduate Program, University of California, Los Angeles, California, USA.
NMR Biomed. 2021 Feb;34(2):e4433. doi: 10.1002/nbm.4433. Epub 2020 Nov 30.
The aim of this study was to develop a deep neural network for respiratory motion compensation in free-breathing cine MRI and evaluate its performance. An adversarial autoencoder network was trained using unpaired training data from healthy volunteers and patients who underwent clinically indicated cardiac MRI examinations. A U-net structure was used for the encoder and decoder parts of the network and the code space was regularized by an adversarial objective. The autoencoder learns the identity map for the free-breathing motion-corrupted images and preserves the structural content of the images, while the discriminator, which interacts with the output of the encoder, forces the encoder to remove motion artifacts. The network was first evaluated based on data that were artificially corrupted with simulated rigid motion with regard to motion-correction accuracy and the presence of any artificially created structures. Subsequently, to demonstrate the feasibility of the proposed approach in vivo, our network was trained on respiratory motion-corrupted images in an unpaired manner and was tested on volunteer and patient data. In the simulation study, mean structural similarity index scores for the synthesized motion-corrupted images and motion-corrected images were 0.76 and 0.93 (out of 1), respectively. The proposed method increased the Tenengrad focus measure of the motion-corrupted images by 12% in the simulation study and by 7% in the in vivo study. The average overall subjective image quality scores for the motion-corrupted images, motion-corrected images and breath-held images were 2.5, 3.5 and 4.1 (out of 5.0), respectively. Nonparametric-paired comparisons showed that there was significant difference between the image quality scores of the motion-corrupted and breath-held images (P < .05); however, after correction there was no significant difference between the image quality scores of the motion-corrected and breath-held images. This feasibility study demonstrates the potential of an adversarial autoencoder network for correcting respiratory motion-related image artifacts without requiring paired data.
本研究旨在开发一种用于自由呼吸电影 MRI 中呼吸运动补偿的深度神经网络,并评估其性能。使用来自健康志愿者和接受临床指示的心脏 MRI 检查的患者的未配对训练数据对对抗自动编码器网络进行了训练。U-net 结构用于网络的编码器和解码器部分,并且代码空间通过对抗性目标进行正则化。自动编码器学习用于自由呼吸运动损坏图像的身份映射,并保留图像的结构内容,而与编码器输出交互的鉴别器迫使编码器去除运动伪影。首先,根据数据评估网络,这些数据是针对运动校正准确性和任何人为创建的结构的存在而用模拟刚性运动人为损坏的。随后,为了证明所提出的方法在体内的可行性,我们以非配对的方式在呼吸运动损坏的图像上训练我们的网络,并在志愿者和患者数据上进行测试。在模拟研究中,合成运动损坏图像和运动校正图像的平均结构相似性指数得分分别为 0.76 和 0.93(满分 1)。该方法在模拟研究中将运动损坏图像的 Tenengrad 聚焦度量提高了 12%,在体内研究中提高了 7%。运动损坏图像、运动校正图像和屏气图像的平均整体主观图像质量评分分别为 2.5、3.5 和 4.1(满分 5.0)。非参数配对比较显示,运动损坏和屏气图像的图像质量评分之间存在显著差异(P <.05);然而,校正后运动校正和屏气图像的图像质量评分之间没有显著差异。这项可行性研究表明,对抗自动编码器网络具有纠正与呼吸运动相关的图像伪影的潜力,而无需配对数据。