School of Ocean Information Engineering, Jimei University, Xiamen, China.
Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China.
BMC Med Imaging. 2024 May 17;24(1):113. doi: 10.1186/s12880-024-01297-2.
Recent Convolutional Neural Networks (CNNs) perform low-error reconstruction in fast Magnetic Resonance Imaging (MRI). Most of them convolve the image with kernels and successfully explore the local information. Nonetheless, the non-local image information, which is embedded among image patches relatively far from each other, may be lost due to the limitation of the receptive field of the convolution kernel. We aim to incorporate a graph to represent non-local information and improve the reconstructed images by using the Graph Convolutional Enhanced Self-Similarity (GCESS) network.
First, the image is reconstructed into the graph to extract the non-local self-similarity in the image. Second, GCESS uses spatial convolution and graph convolution to process the information in the image, so that local and non-local information can be effectively utilized. The network strengthens the non-local similarity between similar image patches while reconstructing images, making the reconstruction of structure more reliable.
Experimental results on in vivo knee and brain data demonstrate that the proposed method achieves better artifact suppression and detail preservation than state-of-the-art methods, both visually and quantitatively. Under 1D Cartesian sampling with 4 × acceleration (AF = 4), the PSNR of knee data reached 34.19 dB, 1.05 dB higher than that of the compared methods; the SSIM achieved 0.8994, 2% higher than the compared methods. Similar results were obtained for the reconstructed images under other sampling templates as demonstrated in our experiment.
The proposed method successfully constructs a hybrid graph convolution and spatial convolution network to reconstruct images. This method, through its training process, amplifies the non-local self-similarities, significantly benefiting the structural integrity of the reconstructed images. Experiments demonstrate that the proposed method outperforms the state-of-the-art reconstruction method in suppressing artifacts, as well as in preserving image details.
最近的卷积神经网络(CNN)在快速磁共振成像(MRI)中实现了低误差重建。它们中的大多数通过卷积核卷积图像,并成功地探索了局部信息。然而,由于卷积核感受野的限制,图像补丁之间相对较远的非局部图像信息可能会丢失。我们旨在引入图来表示非局部信息,并使用图卷积增强自相似性(GCESS)网络来改善重建图像。
首先,将图像重建到图中以提取图像中的非局部自相似性。其次,GCESS 使用空间卷积和图卷积来处理图像中的信息,从而可以有效地利用局部和非局部信息。该网络在重建图像时增强相似图像补丁之间的非局部相似性,从而使结构的重建更加可靠。
在体内膝关节和大脑数据上的实验结果表明,该方法在视觉和定量方面都优于最先进的方法,实现了更好的伪影抑制和细节保留。在 1D 笛卡尔采样中以 4 倍加速(AF=4)下,膝关节数据的 PSNR 达到 34.19dB,比比较方法高 1.05dB;SSIM 达到 0.8994,比比较方法高 2%。在我们的实验中,在其他采样模板下重建的图像也得到了类似的结果。
该方法成功构建了一种混合图卷积和空间卷积网络来重建图像。该方法通过其训练过程放大了非局部自相似性,显著有利于重建图像的结构完整性。实验表明,与最先进的重建方法相比,该方法在抑制伪影和保留图像细节方面表现更好。