Nelson Soren, Menon Rajesh
Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, Utah 84112, USA.
Optica. 2022 Jan 20;9(1):26-31. doi: 10.1364/optica.440575. Epub 2022 Jan 3.
Many deep learning approaches to solve computational imaging problems have proven successful through relying solely on the data. However, when applied to the raw output of a bare (optics-free) image sensor, these methods fail to reconstruct target images that are structurally diverse. In this work we propose a self-consistent supervised model that learns not only the inverse, but also the forward model to better constrain the predictions through encouraging the network to model the ideal bijective imaging system. To do this, we employ cycle consistency alongside traditional reconstruction losses, both of which we show are needed for incoherent optics-free image reconstruction. By eliminating all optics, we demonstrate imaging with the thinnest camera possible.
许多用于解决计算成像问题的深度学习方法仅依靠数据就已被证明是成功的。然而,当应用于裸(无光学元件)图像传感器的原始输出时,这些方法无法重建结构多样的目标图像。在这项工作中,我们提出了一种自洽监督模型,该模型不仅学习逆模型,还学习正向模型,以通过鼓励网络对理想的双射成像系统进行建模来更好地约束预测。为此,我们将循环一致性与传统重建损失一起使用,我们表明这两者对于非相干无光学元件图像重建都是必需的。通过消除所有光学元件,我们展示了使用尽可能薄的相机进行成像。