Zhou Jianing, Guo Hongyu, Chen Hong
School of Electrical Engineering, Shenyang University of Technology, Shenyang 110870, P. R. China.
Neusoft Medical System Co. Ltd, Shenyang 110167, P. R. China.
Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2023 Oct 25;40(5):903-911. doi: 10.7507/1001-5515.202302012.
Magnetic resonance imaging(MRI) can obtain multi-modal images with different contrast, which provides rich information for clinical diagnosis. However, some contrast images are not scanned or the quality of the acquired images cannot meet the diagnostic requirements due to the difficulty of patient's cooperation or the limitation of scanning conditions. Image synthesis techniques have become a method to compensate for such image deficiencies. In recent years, deep learning has been widely used in the field of MRI synthesis. In this paper, a synthesis network based on multi-modal fusion is proposed, which firstly uses a feature encoder to encode the features of multiple unimodal images separately, and then fuses the features of different modal images through a feature fusion module, and finally generates the target modal image. The similarity measure between the target image and the predicted image in the network is improved by introducing a dynamic weighted combined loss function based on the spatial domain and K-space domain. After experimental validation and quantitative comparison, the multi-modal fusion deep learning network proposed in this paper can effectively synthesize high-quality MRI fluid-attenuated inversion recovery (FLAIR) images. In summary, the method proposed in this paper can reduce MRI scanning time of the patient, as well as solve the clinical problem of missing FLAIR images or image quality that is difficult to meet diagnostic requirements.
磁共振成像(MRI)能够获取具有不同对比度的多模态图像,为临床诊断提供了丰富的信息。然而,由于患者配合困难或扫描条件的限制,一些对比度图像未被扫描,或者所获取图像的质量无法满足诊断要求。图像合成技术已成为弥补此类图像缺陷的一种方法。近年来,深度学习在MRI合成领域得到了广泛应用。本文提出了一种基于多模态融合的合成网络,该网络首先使用特征编码器分别对多个单模态图像的特征进行编码,然后通过特征融合模块融合不同模态图像的特征,最后生成目标模态图像。通过引入基于空间域和K空间域的动态加权组合损失函数,提高了网络中目标图像与预测图像之间的相似性度量。经过实验验证和定量比较,本文提出的多模态融合深度学习网络能够有效地合成高质量的MRI液体衰减反转恢复(FLAIR)图像。综上所述,本文提出的方法可以减少患者的MRI扫描时间,同时解决FLAIR图像缺失或图像质量难以满足诊断要求的临床问题。