IEEE Trans Med Imaging. 2020 Sep;39(9):2738-2749. doi: 10.1109/TMI.2020.2974858. Epub 2020 Feb 18.
Magnetic resonance imaging (MRI) is widely used for screening, diagnosis, image-guided therapy, and scientific research. A significant advantage of MRI over other imaging modalities such as computed tomography (CT) and nuclear imaging is that it clearly shows soft tissues in multi-contrasts. Compared with other medical image super-resolution methods that are in a single contrast, multi-contrast super-resolution studies can synergize multiple contrast images to achieve better super-resolution results. In this paper, we propose a one-level non-progressive neural network for low up-sampling multi-contrast super-resolution and a two-level progressive network for high up-sampling multi-contrast super-resolution. The proposed networks integrate multi-contrast information in a high-level feature space and optimize the imaging performance by minimizing a composite loss function, which includes mean-squared-error, adversarial loss, perceptual loss, and textural loss. Our experimental results demonstrate that 1) the proposed networks can produce MRI super-resolution images with good image quality and outperform other multi-contrast super-resolution methods in terms of structural similarity and peak signal-to-noise ratio; 2) combining multi-contrast information in a high-level feature space leads to a significantly improved result than a combination in the low-level pixel space; and 3) the progressive network produces a better super-resolution image quality than the non-progressive network, even if the original low-resolution images were highly down-sampled.
磁共振成像(MRI)广泛用于筛查、诊断、图像引导治疗和科学研究。与其他成像方式(如计算机断层扫描(CT)和核成像)相比,MRI 的一个显著优势是它可以清晰地显示多对比度的软组织。与其他仅在单一对比度下的医学图像超分辨率方法相比,多对比度超分辨率研究可以协同多个对比度图像以获得更好的超分辨率结果。在本文中,我们提出了一种用于低上采样多对比度超分辨率的单级非递进神经网络和一种用于高上采样多对比度超分辨率的两级递进网络。所提出的网络在高级特征空间中集成多对比度信息,并通过最小化包括均方误差、对抗损失、感知损失和纹理损失的复合损失函数来优化成像性能。我们的实验结果表明:1)所提出的网络可以生成具有良好图像质量的 MRI 超分辨率图像,在结构相似性和峰值信噪比方面优于其他多对比度超分辨率方法;2)在高级特征空间中组合多对比度信息比在低级像素空间中组合更能显著提高结果;3)即使原始低分辨率图像被高度下采样,渐进网络也能产生比非渐进网络更好的超分辨率图像质量。