IEEE Trans Vis Comput Graph. 2017 Oct;23(10):2357-2364. doi: 10.1109/TVCG.2016.2628743. Epub 2016 Nov 15.
We propose a concept for a lens attachment that turns a standard DSLR camera and lens into a light field camera. The attachment consists of eight low-resolution, low-quality side cameras arranged around the central high-quality SLR lens. Unlike most existing light field camera architectures, this design provides a high-quality 2D image mode, while simultaneously enabling a new high-quality light field mode with a large camera baseline but little added weight, cost, or bulk compared with the base DSLR camera. From an algorithmic point of view, the high-quality light field mode is made possible by a new light field super-resolution method that first improves the spatial resolution and image quality of the side cameras and then interpolates additional views as needed. At the heart of this process is a super-resolution method that we call iterative Patch- And Depth-based Synthesis (iPADS), which combines patch-based and depth-based synthesis in a novel fashion. Experimental results obtained for both real captured data and synthetic data confirm that our method achieves substantial improvements in super-resolution for side-view images as well as the high-quality and view-coherent rendering of dense and high-resolution light fields.
我们提出了一种镜头附件的概念，它可以将标准的数码单反相机和镜头转换为光场相机。该附件由八个低分辨率、低质量的侧置相机组成，环绕在中央高质量的 SLR 镜头周围。与大多数现有的光场相机架构不同，这种设计提供了高质量的 2D 图像模式，同时能够以较大的相机基线实现新的高质量光场模式，与基本的数码单反相机相比，重量、成本或体积增加很少。从算法角度来看，高质量的光场模式得益于一种新的光场超分辨率方法，该方法首先提高了侧置相机的空间分辨率和图像质量，然后根据需要插值额外的视图。该过程的核心是我们称之为基于迭代补丁和深度的合成（iPADS）的超分辨率方法，它以新颖的方式结合了基于补丁和基于深度的合成。我们对真实拍摄数据和合成数据进行的实验结果证实，我们的方法在侧视图图像的超分辨率以及密集和高分辨率光场的高质量和视图一致渲染方面都取得了实质性的改进。
