Research Center for Humanoid Sensing, Zhejiang Laboratory, Hangzhou, China.
Department of Bioengineering, University of California, Los Angeles, USA.
Nat Commun. 2022 Jun 9;13(1):3333. doi: 10.1038/s41467-022-31087-9.
Inspired by natural living systems, modern cameras can attain three-dimensional vision via multi-view geometry like compound eyes in flies, or time-of-flight sensing like echolocation in bats. However, high-speed, accurate three-dimensional sensing capable of scaling over an extensive distance range and coping well with severe occlusions remains challenging. Here, we report compact light field photography for acquiring large-scale light fields with simple optics and a small number of sensors in arbitrary formats ranging from two-dimensional area to single-point detectors, culminating in a dense multi-view measurement with orders of magnitude lower dataload. We demonstrated compact light field photography for efficient multi-view acquisition of time-of-flight signals to enable snapshot three-dimensional imaging with an extended depth range and through severe scene occlusions. Moreover, we show how compact light field photography can exploit curved and disconnected surfaces for real-time non-line-of-sight 3D vision. Compact light field photography will broadly benefit high-speed 3D imaging and open up new avenues in various disciplines.
受自然生物系统的启发,现代相机可以通过类似蝇复眼的多视角几何结构或类似蝙蝠声纳的飞行时间感测来实现三维视觉。然而,能够在广泛的距离范围内实现高速、精确的三维感应,并且能够很好地应对严重遮挡的情况仍然具有挑战性。在这里,我们报告了一种紧凑的光场摄影技术,该技术使用简单的光学器件和少量传感器,可在从二维区域到单点探测器的任意格式中获取大规模光场,最终以数量级更低的数据负载实现密集的多视角测量。我们展示了紧凑的光场摄影技术,用于高效地获取飞行时间信号的多视角采集,从而实现具有扩展景深和穿透严重场景遮挡的快照式三维成像。此外,我们还展示了如何利用弯曲和不连续的表面进行实时非视距三维视觉。紧凑的光场摄影将广泛受益于高速三维成像,并在各个领域开辟新的途径。