Shang Ruibo, O'Brien Mikaela A, Wang Fei, Situ Guohai, Luke Geoffrey P
Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA.
Department of Bioengineering, University of Washington, Seattle, WA 98195, USA.
Commun Eng. 2023;2. doi: 10.1038/s44172-023-00103-1. Epub 2023 Aug 1.
Single-pixel imaging (SPI) has the advantages of high-speed acquisition over a broad wavelength range and system compactness. Deep learning (DL) is a powerful tool that can achieve higher image quality than conventional reconstruction approaches. Here, we propose a Bayesian convolutional neural network (BCNN) to approximate the uncertainty of the DL predictions in SPI. Each pixel in the predicted image represents a probability distribution rather than an image intensity value, indicating the uncertainty of the prediction. We show that the BCNN uncertainty predictions are correlated to the reconstruction errors. When the BCNN is trained and used in practical applications where the ground truths are unknown, the level of the predicted uncertainty can help to determine whether system, data, or network adjustments are needed. Overall, the proposed BCNN can provide a reliable tool to indicate the confidence levels of DL predictions as well as the quality of the model and dataset for many applications of SPI.
单像素成像(SPI)具有在宽波长范围内高速采集和系统紧凑的优点。深度学习(DL)是一种强大的工具,能够实现比传统重建方法更高的图像质量。在此,我们提出一种贝叶斯卷积神经网络(BCNN)来近似SPI中DL预测的不确定性。预测图像中的每个像素代表一个概率分布而非图像强度值,这表明了预测的不确定性。我们表明BCNN不确定性预测与重建误差相关。当BCNN在实际应用中进行训练且真实情况未知时,预测的不确定性水平有助于确定是否需要对系统、数据或网络进行调整。总体而言,所提出的BCNN可为许多SPI应用提供一个可靠工具,以指示DL预测的置信水平以及模型和数据集的质量。