IEEE Trans Vis Comput Graph. 2017 May;23(5):1561-1573. doi: 10.1109/TVCG.2016.2532329. Epub 2016 Feb 19.
Patch-based image synthesis methods have been successfully applied for various editing tasks on still images, videos and stereo pairs. In this work we extend patch-based synthesis to plenoptic images captured by consumer-level lenselet-based devices for interactive, efficient light field editing. In our method the light field is represented as a set of images captured from different viewpoints. We decompose the central view into different depth layers, and present it to the user for specifying the editing goals. Given an editing task, our method performs patch-based image synthesis on all affected layers of the central view, and then propagates the edits to all other views. Interaction is done through a conventional 2D image editing user interface that is familiar to novice users. Our method correctly handles object boundary occlusion with semi-transparency, thus can generate more realistic results than previous methods. We demonstrate compelling results on a wide range of applications such as hole-filling, object reshuffling and resizing, changing object depth, light field upscaling and parallax magnification.
基于补丁的图像合成方法已成功应用于静态图像、视频和立体对的各种编辑任务。在这项工作中，我们将基于补丁的合成扩展到了基于消费级微透镜设备捕获的光场图像，以实现交互式、高效的光场编辑。在我们的方法中，光场表示为从不同视角捕获的一组图像。我们将中心视图分解为不同的深度层，并将其呈现给用户以指定编辑目标。给定一个编辑任务，我们的方法在中心视图的所有受影响的层上执行基于补丁的图像合成，然后将编辑传播到所有其他视图。交互是通过传统的 2D 图像编辑用户界面完成的，这对新手用户来说很熟悉。我们的方法可以正确处理半透明的物体边界遮挡，因此可以生成比以前的方法更逼真的结果。我们在广泛的应用中展示了引人注目的结果，例如填补空洞、重新排列和调整大小、改变物体深度、光场放大和视差放大。
