IEEE Trans Pattern Anal Mach Intell. 2018 Jan;40(1):133-147. doi: 10.1109/TPAMI.2017.2653101. Epub 2017 Jan 16.
In this article we develop an image based rendering technique based on light field reconstruction from a limited set of perspective views acquired by cameras. Our approach utilizes sparse representation of epipolar-plane images (EPI) in shearlet transform domain. The shearlet transform has been specifically modified to handle the straight lines characteristic for EPI. The devised iterative regularization algorithm based on adaptive thresholding provides high-quality reconstruction results for relatively big disparities between neighboring views. The generated densely sampled light field of a given 3D scene is thus suitable for all applications which require light field reconstruction. The proposed algorithm compares favorably against state of the art depth image based rendering techniques and shows superior performance specifically in reconstructing scenes containing semi-transparent objects.
本文提出了一种基于有限视角相机采集的光场重建的图像渲染技术。我们的方法利用了基于剪切波变换域的极平面图像（EPI）稀疏表示。剪切波变换经过特殊修改，以处理 EPI 的直线特征。基于自适应阈值的迭代正则化算法为相邻视图之间较大的视差提供了高质量的重建结果。生成的给定 3D 场景的密集采样光场适用于所有需要光场重建的应用。与最先进的基于深度图像的渲染技术相比，所提出的算法具有优势，特别是在重建包含半透明物体的场景时表现更优。
