CISE department, University of Florida, 32603, USA.
Neural Netw. 2024 Dec;180:106740. doi: 10.1016/j.neunet.2024.106740. Epub 2024 Sep 17.
The success of deep image prior (DIP) in a number of image processing tasks has motivated their application in image reconstruction problems in computed tomography (CT). In this paper, we introduce a residual back projection technique (RBP) that improves the performance of deep image prior framework in iterative CT reconstruction, especially when the reconstruction problem is highly ill-posed. The RBP-DIP framework uses an untrained U-net in conjunction with a novel residual back projection connection to minimize the objective function while improving reconstruction accuracy. In each iteration, the weights of the untrained U-net are optimized, and the output of the U-net in the current iteration is used to update the input of the U-net in the next iteration through the proposed RBP connection. The introduction of the RBP connection strengthens the regularization effects of the DIP framework in the context of iterative CT reconstruction leading to improvements in accuracy. Our experiments demonstrate that the RBP-DIP framework offers improvements over other state-of-the-art conventional IR methods, as well as pre-trained and untrained models with similar network structures under multiple conditions. These improvements are particularly significant in the few-view and limited-angle CT reconstructions, where the corresponding inverse problems are highly ill-posed and the training data is limited. Furthermore, RBP-DIP has the potential for further improvement. Most existing IR algorithms, pre-trained models, and enhancements applicable to the original DIP algorithm can also be integrated into the RBP-DIP framework.
深度图像先验(DIP)在许多图像处理任务中的成功,促使其在计算机断层扫描(CT)的图像重建问题中得到应用。在本文中,我们引入了一种残差反向投影技术(RBP),该技术可提高深度图像先验框架在迭代 CT 重建中的性能,特别是在重建问题高度不适定的情况下。RBP-DIP 框架使用未经训练的 U-Net 结合新颖的残差反向投影连接,在提高重建准确性的同时最小化目标函数。在每次迭代中,优化未训练的 U-Net 的权重,并通过所提出的 RBP 连接,使用当前迭代中 U-Net 的输出来更新下一次迭代中 U-Net 的输入。RBP 连接的引入增强了 DIP 框架在迭代 CT 重建中的正则化效果,从而提高了准确性。我们的实验表明,RBP-DIP 框架在多种条件下,相较于其他最先进的传统 IR 方法、具有类似网络结构的预训练和未训练模型,都能提供更好的性能。在少视角和有限角度 CT 重建中,这些改进尤为显著,因为对应的逆问题高度不适定,并且训练数据有限。此外,RBP-DIP 还有进一步改进的潜力。大多数现有的 IR 算法、预训练模型以及适用于原始 DIP 算法的增强功能,也可以集成到 RBP-DIP 框架中。