Wu Sidong, Zhang Gexiang, Jiang Tao, Zhu Ming, Fu Kechang, Rong Haina, Xian Kaiyi, Song Hui, Kuhnert Klaus-Dieter
Appl Opt. 2018 Mar 1;57(7):B160-B169. doi: 10.1364/AO.57.00B160.
The artificial compound eye is a new type of camera that has miniature volume and large field of view (FOV), while the captured image is an array of sub-images, and each sub-image captures a part of the full FOV. To obtain a complete image with a full FOV, reconstruction is needed. Due to the parallax between adjacent sub-images, the reconstruction of images is depth related. In this paper, to address the image reconstruction of a specific artificial compound eye-eCley-a cross image belief propagation method is proposed to estimate the depth map. Since the small size and small FOV of the sub-image lead to little contextual information for pairwise matching, the information of neighboring sub-images is integrated into the belief propagation step to propagate the message across images. Therefore, the belief propagation step is able to gather as much information as needed from all the sub-images to obtain an accurate depth result. As a consequence, a stereo image with the full FOV and corresponding depth map can be obtained based on the estimated depth of sub-images. Experimental results on real data show the effectiveness of the proposed method.
人工复眼是一种新型相机，具有体积小、视野大的特点，所捕获的图像是子图像阵列，每个子图像捕获全视野的一部分。为了获得具有全视野的完整图像，需要进行重建。由于相邻子图像之间存在视差，图像重建与深度相关。本文针对一种特定的人工复眼——eCley，提出了一种交叉图像置信传播方法来估计深度图。由于子图像尺寸小、视野小，导致用于成对匹配的上下文信息很少，因此将相邻子图像的信息整合到置信传播步骤中，以便在图像间传播消息。因此，置信传播步骤能够从所有子图像中收集所需的尽可能多的信息，以获得准确的深度结果。结果，基于子图像的估计深度，可以获得具有全视野的立体图像和相应的深度图。对真实数据的实验结果表明了该方法的有效性。
