Otto-von-Guericke University Magdeburg, Faculty of Computer Science, 39106, Magdeburg, Germany.
Department of Radiology and Nuclear Medicine, University Hospital Magdeburg, 39120, Magdeburg, Germany.
Sci Rep. 2023 Jul 11;13(1):11227. doi: 10.1038/s41598-023-38073-1.
Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack temporal/spatial resolution, and have long prior acquisitions or reconstruction times. Deep learning-based (DL) 4D MRI approaches promise to overcome these shortcomings but are sensitive to domain shift. This work shows that transfer learning (TL) combined with an ensembling strategy can help alleviate this key challenge. We evaluate four approaches: pre-trained models from the source domain, models directly trained from scratch on target domain data, models fine-tuned from a pre-trained model and an ensemble of fine-tuned models. For that the data base was split into 16 source and 4 target domain subjects. Comparing ensemble of fine-tuned models (N = 10) with directly learned models, we report significant improvements (P < 0.001) of the root mean squared error (RMSE) of up to 12% and the mean displacement (MDISP) of up to 17.5%. The smaller the target domain data amount, the larger the effect. This shows that TL + Ens significantly reduces beforehand acquisition time and improves reconstruction quality, rendering it a key component in making 4D MRI clinically feasible for the first time in the context of 4D organ motion models of the liver and beyond.
时分辨磁共振成像(4D MRI)可用于解决肿瘤消融等图像引导介入中的器官运动问题。目前的 4D 重建技术不适用于大多数介入环境,因为它们仅限于特定的呼吸阶段,缺乏时间/空间分辨率,并且具有较长的前期采集或重建时间。基于深度学习(DL)的 4D MRI 方法有望克服这些缺点,但对域转移敏感。这项工作表明,迁移学习(TL)与集成策略相结合可以帮助缓解这一关键挑战。我们评估了四种方法:来自源域的预训练模型、直接从目标域数据从头开始训练的模型、从预训练模型和经过微调的模型集成中微调的模型。为此,数据库被分为 16 个源域和 4 个目标域。与直接学习的模型相比,对集成微调模型(N=10)进行比较,我们报告了高达 12%的均方根误差(RMSE)和高达 17.5%的平均位移(MDISP)的显著改进(P<0.001)。目标域数据量越小,效果越大。这表明 TL+Ens 显著减少了前期采集时间,并提高了重建质量,使其成为在肝等 4D 器官运动模型的背景下,4D MRI 首次在临床上可行的关键组成部分。