Li Ying, Li Zhengdai, Chen Kaiyu, Guo Youming, Rao Changhui
Opt Express. 2023 Nov 6;31(23):39088-39101. doi: 10.1364/OE.501970.
Lensless cameras, consisting of only a sensor and a mask, are small and flexible enough to be used in many applications with stringent scale constraints. These mask-based imagers encode scenes in caustic patterns. Most existing reconstruction algorithms rely on multiple iterations based on physical model for deconvolution followed by deep learning for perception, among which the main limitation of reconstruction quality is the mismatch between the ideal and the real model. To solve the problem, we in this work learned a class of multi Wiener deconvolution networks (MWDNs), deconvoluting in multi-scale feature spaces with Wiener filters to reduce the information loss and improving the accuracy of the given model by correcting the inputs. A comparison between the proposed and the state-of-the-art algorithms shows that ours achieves much better images and performs well in real-world environments. In addition, our method takes greater advantage of the computational time due to the abandonment of iterations.
无透镜相机仅由一个传感器和一个掩膜组成,体积小且灵活,足以用于许多有严格尺寸限制的应用中。这些基于掩膜的成像器以焦散图案对场景进行编码。大多数现有的重建算法基于物理模型进行多次迭代以进行反卷积,然后通过深度学习进行感知,其中重建质量的主要限制是理想模型与实际模型之间的不匹配。为了解决这个问题,我们在这项工作中学习了一类多维纳反卷积网络(MWDN),它在多尺度特征空间中使用维纳滤波器进行反卷积,以减少信息损失,并通过校正输入来提高给定模型的准确性。将所提出的算法与当前最先进的算法进行比较表明,我们的算法能生成质量更好的图像,并且在现实环境中表现良好。此外,由于我们的方法无需进行迭代,因此在计算时间上更具优势。