Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
Siemens Healthcare GmbH, Erlangen, Germany.
Med Phys. 2023 Apr;50(4):2148-2161. doi: 10.1002/mp.16119. Epub 2022 Dec 13.
Intra-scan rigid-body motion is a costly and ubiquitous problem in clinical magnetic resonance imaging (MRI) of the head.
State-of-the-art methods for retrospective motion correction in MRI are often computationally expensive or in the case of image-to-image deep learning (DL) based methods can be prone to undesired alterations of the image (hallucinations'). In this work we introduce a novel rigid-body motion correction method which combines the advantages of classical model-driven and data-consistency (DC) preserving approaches with a novel DL algorithm, to provide fast and robust retrospective motion correction.
The proposed Motion Parameter Estimating Densenet (MoPED) retrospectively estimates subject head motion during MRI acquisitions using a DL network with DenseBlocks and multitask learning. It quantifies the 2D rigid in-plane motion parameters slice-wise for each echo train (ET) of a Cartesian T2-weighted 2D Turbo-Spin-Echo sequence. The network receives a center patch of the motion corrupted k-space as well as an additional motion-free low-resolution reference scan to provide the ground truth orientation. The supervised training utilizes motion simulations based on 28 acquisitions with subject-wise training, validation, and test data splits of 70%, 23%, and 7%. During inference, MoPED is embedded in an iterative DC-driven motion correction algorithm which alternatingly updates estimates of the motion parameters and motion-corrected low-resolution k-space data. The estimated motion parameters are then used to reconstruct the final motion corrected image. The mean absolute/squared error and the Pearson correlation coefficient were used to analyze the motion parameter estimation quality on in-silico data in a quantitative evaluation. Structural similarity (SSIM), DC error and root mean squared error (RMSE) were used as metrics of image quality improvement. Furthermore, the generalization capability of the network was analyzed on two in-vivo motion volumes with 28 slices each and on one simulated T1-weighted volume.
The motion estimation achieves a Pearson correlation of 0.968 to the simulated ground-truth of the 2433 test data slices used. In-silico results indicate that MoPED decreases the time for the optimization by a factor of around 27 compared to a conventional method and is able to reduce the RMSE of the reconstructions and average DC error by more than a factor of two compared to uncorrected images. In-vivo experiments show a decrease in computation time by a factor of around 20, a RMSE decrease from 0.055 to 0.033 and an SSIM increase from 0.795 to 0.862. Furthermore, contrast independence is demonstrated as MoPED is also able to correct T1-weighted images in simulations without retraining. Due to the model-based correction, no hallucinations were observed.
Incorporating DL in a model-based motion correction algorithm shows great benefit on the optimization and computation time. The k-space-based estimation also allows a data consistent correction and therefore avoids the risk of hallucinations of image-to-image approaches.
在头部临床磁共振成像(MRI)中,扫描内刚体运动是一个代价高昂且普遍存在的问题。
用于 MRI 中回顾性运动校正的最先进方法通常计算成本高昂,或者在基于图像到图像深度学习(DL)的方法的情况下,可能容易导致图像出现不期望的改变(幻觉)。在这项工作中,我们引入了一种新的刚体运动校正方法,该方法结合了经典模型驱动和数据一致性(DC)保持方法的优点,以及一种新的 DL 算法,以提供快速而稳健的回顾性运动校正。
所提出的运动参数估计 Densenet(MoPED)使用具有 DenseBlocks 和多任务学习的 DL 网络,在 MRI 采集期间对受试者头部运动进行回顾性估计。它针对笛卡尔 T2 加权 2D 涡轮自旋回波序列的每个回波列车(ET),对 2D 刚性平面内运动参数进行切片式量化。网络接收运动污染的 k 空间的中心斑块以及额外的无运动低分辨率参考扫描,以提供真实方向。基于具有受试者特定训练、验证和测试数据 70%、23%和 7%的分割的 28 次采集的运动模拟进行有监督训练。在推断过程中,MoPED 被嵌入到迭代 DC 驱动的运动校正算法中,该算法交替更新运动参数和运动校正的低分辨率 k 空间数据的估计值。然后,使用估计的运动参数来重建最终的运动校正图像。在定量评估中,使用平均绝对/平方误差和皮尔逊相关系数来分析基于仿真数据的运动参数估计质量。结构相似性(SSIM)、DC 误差和均方根误差(RMSE)被用作图像质量提高的度量。此外,还分析了网络在两个具有 28 个切片的体内运动卷和一个模拟的 T1 加权卷上的泛化能力。
运动估计与使用的 2433 个测试数据切片的模拟地面实况的皮尔逊相关系数达到 0.968。基于仿真的结果表明,与传统方法相比,MoPED 将优化时间缩短了约 27 倍,并且与未校正图像相比,能够将重建的 RMSE 和平均 DC 误差降低两倍以上。体内实验表明,计算时间缩短了约 20 倍,RMSE 从 0.055 降低到 0.033,SSIM 从 0.795 提高到 0.862。此外,还证明了对比度独立性,因为 MoPED 也能够在没有重新训练的情况下校正模拟的 T1 加权图像。由于基于模型的校正,没有观察到幻觉。
在基于模型的运动校正算法中纳入 DL 具有很大的优化和计算时间优势。基于 k 空间的估计还允许进行一致的数据校正,从而避免了图像到图像方法出现幻觉的风险。