IEEE J Biomed Health Inform. 2024 Nov;28(11):6751-6763. doi: 10.1109/JBHI.2024.3432139. Epub 2024 Nov 6.
Integrating complementary information from multiple magnetic resonance imaging (MRI) modalities is often necessary to make accurate and reliable diagnostic decisions. However, the different acquisition speeds of these modalities mean that obtaining information can be time consuming and require significant effort. Reference-based MRI reconstruction aims to accelerate slower, under-sampled imaging modalities, such as T2-modality, by utilizing redundant information from faster, fully sampled modalities, such as T1-modality. Unfortunately, spatial misalignment between different modalities often negatively impacts the final results. To address this issue, we propose FEFA, which consists of cascading FEFA blocks. The FEFA block first aligns and fuses the two modalities at the feature level. The combined features are then filtered in the frequency domain to enhance the important features while simultaneously suppressing the less essential ones, thereby ensuring accurate reconstruction. Furthermore, we emphasize the advantages of combining the reconstruction results from multiple cascaded blocks, which also contributes to stabilizing the training process. Compared to existing registration-then-reconstruction and cross-attention-based approaches, our method is end-to-end trainable without requiring additional supervision, extensive parameters, or heavy computation. Experiments on the public fastMRI, IXI and in-house datasets demonstrate that our approach is effective across various under-sampling patterns and ratios.
整合来自多种磁共振成像(MRI)模态的互补信息对于做出准确可靠的诊断决策通常是必要的。然而,这些模态的不同采集速度意味着获取信息可能既耗时又费力。基于参考的 MRI 重建旨在通过利用更快、完全采样的模态(例如 T1 模态)的冗余信息来加速较慢、欠采样的模态(例如 T2 模态)。不幸的是,不同模态之间的空间失准通常会对最终结果产生负面影响。为了解决这个问题,我们提出了 FEFA,它由级联的 FEFA 块组成。FEFA 块首先在特征级别对齐和融合两种模态。然后,将组合特征在频域中进行滤波,以增强重要特征,同时抑制不太重要的特征,从而确保准确的重建。此外,我们强调了结合多个级联块的重建结果的优势,这也有助于稳定训练过程。与现有的基于配准的重建和交叉注意的方法相比,我们的方法是端到端可训练的,不需要额外的监督、大量的参数或繁重的计算。在公共 fastMRI、IXI 和内部数据集上的实验表明,我们的方法在各种欠采样模式和比例下都是有效的。