Lyu Jun, Wang Shuo, Tian Yapeng, Zou Jing, Dong Shunjie, Wang Chengyan, Aviles-Rivero Angelica I, Qin Jing
School of Computer and Control Engineering, Yantai University, Yantai, China.
School of Basic Medical Sciences, Fudan University, Shanghai, China.
Med Image Anal. 2024 May;94:103142. doi: 10.1016/j.media.2024.103142. Epub 2024 Mar 12.
Cardiac cine magnetic resonance imaging (MRI) is a commonly used clinical tool for evaluating cardiac function and morphology. However, its diagnostic accuracy may be compromised by the low spatial resolution. Current methods for cine MRI super-resolution reconstruction still have limitations. They typically rely on 3D convolutional neural networks or recurrent neural networks, which may not effectively capture long-range or non-local features due to their limited receptive fields. Optical flow estimators are also commonly used to align neighboring frames, which may cause information loss and inaccurate motion estimation. Additionally, pre-warping strategies may involve interpolation, leading to potential loss of texture details and complicated anatomical structures. To overcome these challenges, we propose a novel Spatial-Temporal Attention-Guided Dual-Path Network (STADNet) for cardiac cine MRI super-resolution. We utilize transformers to model long-range dependencies in cardiac cine MR images and design a cross-frame attention module in the location-aware spatial path, which enhances the spatial details of the current frame by using complementary information from neighboring frames. We also introduce a recurrent flow-enhanced attention module in the motion-aware temporal path that exploits the correlation between cine MRI frames and extracts the motion information of the heart. Experimental results demonstrate that STADNet outperforms SOTA approaches and has significant potential for clinical practice.
心脏电影磁共振成像(MRI)是一种常用的评估心脏功能和形态的临床工具。然而,其诊断准确性可能会受到低空间分辨率的影响。目前用于电影MRI超分辨率重建的方法仍然存在局限性。它们通常依赖于3D卷积神经网络或循环神经网络,由于其有限的感受野,可能无法有效地捕捉远距离或非局部特征。光流估计器也常用于对齐相邻帧,这可能会导致信息丢失和不准确的运动估计。此外,预扭曲策略可能涉及插值,导致纹理细节和复杂解剖结构的潜在丢失。为了克服这些挑战,我们提出了一种用于心脏电影MRI超分辨率的新型时空注意力引导双路径网络(STADNet)。我们利用Transformer对心脏电影MR图像中的长程依赖性进行建模,并在位置感知空间路径中设计了一个跨帧注意力模块,该模块通过使用相邻帧的互补信息来增强当前帧的空间细节。我们还在运动感知时间路径中引入了一个循环流增强注意力模块,该模块利用电影MRI帧之间的相关性并提取心脏的运动信息。实验结果表明,STADNet优于现有最佳方法,在临床实践中具有巨大潜力。