Data and Knowledge Engineering Group, Faculty of Computer Science, Otto von Guericke University Magdeburg, Germany; Research Campus STIMULATE, Otto von Guericke University Magdeburg, Germany.
Data and Knowledge Engineering Group, Faculty of Computer Science, Otto von Guericke University Magdeburg, Germany; Genomics Research Centre, Human Technopole, Milan, Italy.
Neural Netw. 2023 Sep;166:704-721. doi: 10.1016/j.neunet.2023.08.004. Epub 2023 Aug 9.
Computed tomography (CT) and magnetic resonance imaging (MRI) are two widely used clinical imaging modalities for non-invasive diagnosis. However, both of these modalities come with certain problems. CT uses harmful ionising radiation, and MRI suffers from slow acquisition speed. Both problems can be tackled by undersampling, such as sparse sampling. However, such undersampled data leads to lower resolution and introduces artefacts. Several techniques, including deep learning based methods, have been proposed to reconstruct such data. However, the undersampled reconstruction problem for these two modalities was always considered as two different problems and tackled separately by different research works. This paper proposes a unified solution for both sparse CT and undersampled radial MRI reconstruction, achieved by applying Fourier transform-based pre-processing on the radial MRI and then finally reconstructing both modalities using sinogram upsampling combined with filtered back-projection. The Primal-Dual network is a deep learning based method for reconstructing sparsely-sampled CT data. This paper introduces Primal-Dual UNet, which improves the Primal-Dual network in terms of accuracy and reconstruction speed. The proposed method resulted in an average SSIM of 0.932±0.021 while performing sparse CT reconstruction for fan-beam geometry with a sparsity level of 16, achieving a statistically significant improvement over the previous model, which resulted in 0.919±0.016. Furthermore, the proposed model resulted in 0.903±0.019 and 0.957±0.023 average SSIM while reconstructing undersampled brain and abdominal MRI data with an acceleration factor of 16, respectively - statistically significant improvements over the original model, which resulted in 0.867±0.025 and 0.949±0.025. Finally, this paper shows that the proposed network not only improves the overall image quality, but also improves the image quality for the regions-of-interest: liver, kidneys, and spleen; as well as generalises better than the baselines in presence the of a needle.
计算机断层扫描(CT)和磁共振成像(MRI)是两种广泛应用于非侵入性诊断的临床成像方式。然而,这两种方式都存在一定的问题。CT 使用有害的电离辐射,而 MRI 则存在采集速度慢的问题。这些问题都可以通过欠采样来解决,例如稀疏采样。然而,这种欠采样数据会导致分辨率降低,并引入伪影。已经提出了几种技术,包括基于深度学习的方法,用于重建这种数据。然而,这两种模态的欠采样重建问题一直被视为两个不同的问题,并由不同的研究工作分别解决。本文提出了一种用于稀疏 CT 和欠采样径向 MRI 重建的统一解决方案,通过对径向 MRI 进行基于傅里叶变换的预处理,然后最终使用正弦图上采样和滤波反投影来重建这两种模态。对偶网络是一种用于重建稀疏采样 CT 数据的深度学习方法。本文引入了对偶 UNet,它在准确性和重建速度方面对对偶网络进行了改进。该方法在扇束几何中进行稀疏 CT 重建时,稀疏度为 16,得到的平均 SSIM 为 0.932±0.021,与之前的模型相比有显著提高,之前的模型得到的平均 SSIM 为 0.919±0.016。此外,该模型在对加速因子为 16 的脑部和腹部 MRI 数据进行欠采样重建时,分别得到了 0.903±0.019 和 0.957±0.023 的平均 SSIM,与原始模型相比有显著提高,原始模型得到的平均 SSIM 为 0.867±0.025 和 0.949±0.025。最后,本文表明,该网络不仅提高了整体图像质量,而且还提高了感兴趣区域的图像质量:肝脏、肾脏和脾脏;并且在存在针的情况下比基线更好地泛化。