Raymond Catalina, Yao Jingwen, Clifford Bryan, Feiweier Thorsten, Oshima Sonoko, Telesca Donatello, Zhong Xiaodong, Meyer Heiko, Everson Richard G, Salamon Noriko, Cloughesy Timothy F, Ellingson Benjamin M
From the UCLA Brain Tumor Imaging Laboratory (C.R., J.Y., S.O., B.M.E.), David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA.
Department of Radiological Sciences (C.R., J.Y., S.O., X.Z., N.S., B.M.E), David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA.
AJNR Am J Neuroradiol. 2025 Apr 2;46(4):733-741. doi: 10.3174/ajnr.A8566.
This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.
A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified architecture with an generator was used for the model. Three training strategies were employed: (1) An "all-in-one" model trained on all the artifacts at once; (2) a set of "single models", one for each artifact; and a (3) "stacked transfer learning" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the "Stacked Transfer Learning" model was tested on ADC maps from single-shot diffusion MRI data in = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.
The "stacked transfer learning" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.
The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a "stacked transfer learning" approach to training a GAN for reduction of EPI-based artifacts.
本研究采用基于物理的方法来合成逼真的磁共振成像伪影,并训练一个深度学习生成对抗网络(GAN),用于减少回波平面成像(EPI)中的伪影。EPI是一种关键的神经成像序列,具有高加速特性,但极易受到伪影影响。
共使用了1392例接受临床脑部磁共振成像检查患者的4573个解剖学磁共振序列,利用基于物理的、EPI中常见的模拟伪影创建了一个合成数据集。通过使用多种磁共振成像对比,我们假设GAN能够学会校正常见伪影,同时保留固有的对比信息,即使对于网络未经过训练的对比也能如此。模型采用了一种带有生成器的改进架构。采用了三种训练策略:(1)一个“一体化”模型,一次性对所有伪影进行训练;(2)一组“单一模型”,每个伪影对应一个模型;(3)“堆叠式迁移学习”方法,即首先在一个伪影集上训练一个模型,然后将这种学习迁移到一个新模型,对下一个伪影集重复此过程。最后,在49例诊断为复发性胶质母细胞瘤的患者的单次激发扩散磁共振成像数据的表观扩散系数(ADC)图上对“堆叠式迁移学习”模型进行测试,以比较原始采集图像和人工智能校正图像之间的视觉质量和病变测量结果。
与其他方法相比,“堆叠式迁移学习”方法在减少伪影方面具有更优的性能,通过均方误差(MSE = 0.0016)、结构相似性指数(SSIM = 0.92)、多尺度结构相似性指数(MS - SSIM = 0.92)、峰值信噪比(PSNR = 28.10)和豪斯多夫距离(HAUS = 4.08mm)来衡量,这表明利用预训练知识并对每个伪影进行顺序训练是该应用的最佳方法。在复发性胶质母细胞瘤中,与原始图像相比,模型预测图像的视觉质量显著更高,而肿瘤区域内的定量测量结果与未校正图像保持一致。
本研究证明了使用基于物理的方法合成具有逼真伪影的大数据集图像的可行性,以及在“堆叠式迁移学习”方法中利用该合成数据集训练GAN以减少基于EPI的伪影的有效性。