Department of Electrical Engineering, Stanford University, Stanford, California, USA.
Department of Radiology, Stanford University, Stanford, California, USA.
Magn Reson Med. 2023 Nov;90(5):2052-2070. doi: 10.1002/mrm.29759. Epub 2023 Jul 10.
To develop a method for building MRI reconstruction neural networks robust to changes in signal-to-noise ratio (SNR) and trainable with a limited number of fully sampled scans.
We propose Noise2Recon, a consistency training method for SNR-robust accelerated MRI reconstruction that can use both fully sampled (labeled) and undersampled (unlabeled) scans. Noise2Recon uses unlabeled data by enforcing consistency between model reconstructions of undersampled scans and their noise-augmented counterparts. Noise2Recon was compared to compressed sensing and both supervised and self-supervised deep learning baselines. Experiments were conducted using retrospectively accelerated data from the mridata three-dimensional fast-spin-echo knee and two-dimensional fastMRI brain datasets. All methods were evaluated in label-limited settings and among out-of-distribution (OOD) shifts, including changes in SNR, acceleration factors, and datasets. An extensive ablation study was conducted to characterize the sensitivity of Noise2Recon to hyperparameter choices.
In label-limited settings, Noise2Recon achieved better structural similarity, peak signal-to-noise ratio, and normalized-RMS error than all baselines and matched performance of supervised models, which were trained with more fully sampled scans. Noise2Recon outperformed all baselines, including state-of-the-art fine-tuning and augmentation techniques, among low-SNR scans and when generalizing to OOD acceleration factors. Augmentation extent and loss weighting hyperparameters had negligible impact on Noise2Recon compared to supervised methods, which may indicate increased training stability.
Noise2Recon is a label-efficient reconstruction method that is robust to distribution shifts, such as changes in SNR, acceleration factors, and others, with limited or no fully sampled training data.
开发一种针对信噪比 (SNR) 变化具有稳健性的 MRI 重建神经网络构建方法,并能够使用有限数量的完全采样扫描进行训练。
我们提出了 Noise2Recon,这是一种针对 SNR 稳健的加速 MRI 重建的一致性训练方法,可同时使用完全采样(标记)和欠采样(未标记)扫描。Noise2Recon 通过在欠采样扫描的模型重建与其噪声增强对应物之间强制一致性,利用未标记数据。Noise2Recon 与压缩感知以及监督和自监督深度学习基线进行了比较。实验使用来自 mridata 三维快速自旋回波膝关节和二维 fastMRI 大脑数据集的回顾性加速数据进行。所有方法都在标签有限的设置和分布外(OOD)变化中进行了评估,包括 SNR、加速因子和数据集的变化。进行了广泛的消融研究,以表征 Noise2Recon 对超参数选择的敏感性。
在标签有限的设置中,Noise2Recon 在结构相似性、峰值信噪比和归一化均方根误差方面优于所有基线和具有更多完全采样扫描的监督模型的性能。Noise2Recon 在低 SNR 扫描和推广到 OOD 加速因子时,优于所有基线,包括最先进的微调和增强技术。与需要更多完全采样训练数据的监督方法相比,增强程度和损失加权超参数对 Noise2Recon 的影响可以忽略不计,这可能表明训练稳定性增加。
Noise2Recon 是一种标签高效的重建方法,对分布变化具有稳健性,例如 SNR、加速因子等变化,具有有限或没有完全采样训练数据。