Shen Liyue, Pauly John, Xing Lei
IEEE Trans Neural Netw Learn Syst. 2022 Jun 3;PP. doi: 10.1109/TNNLS.2022.3177134.
Image reconstruction is an inverse problem that solves for a computational image based on sampled sensor measurement. Sparsely sampled image reconstruction poses additional challenges due to limited measurements. In this work, we propose a methodology of implicit Neural Representation learning with Prior embedding (NeRP) to reconstruct a computational image from sparsely sampled measurements. The method differs fundamentally from previous deep learning-based image reconstruction approaches in that NeRP exploits the internal information in an image prior and the physics of the sparsely sampled measurements to produce a representation of the unknown subject. No large-scale data is required to train the NeRP except for a prior image and sparsely sampled measurements. In addition, we demonstrate that NeRP is a general methodology that generalizes to different imaging modalities such as computed tomography (CT) and magnetic resonance imaging (MRI). We also show that NeRP can robustly capture the subtle yet significant image changes required for assessing tumor progression.
图像重建是一个逆问题,它基于采样的传感器测量值求解计算图像。由于测量有限,稀疏采样图像重建带来了额外的挑战。在这项工作中,我们提出了一种具有先验嵌入的隐式神经表示学习(NeRP)方法,用于从稀疏采样测量中重建计算图像。该方法与以前基于深度学习的图像重建方法有根本区别,因为NeRP利用图像先验中的内部信息和稀疏采样测量的物理特性来生成未知对象的表示。除了先验图像和稀疏采样测量外,不需要大规模数据来训练NeRP。此外,我们证明NeRP是一种通用方法,可以推广到不同的成像模态,如计算机断层扫描(CT)和磁共振成像(MRI)。我们还表明,NeRP可以稳健地捕捉评估肿瘤进展所需的细微但显著的图像变化。