微透镜全光视频编码的光线-空间运动补偿。

Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding.

出版信息

IEEE Trans Image Process. 2023;32:1215-1230. doi: 10.1109/TIP.2022.3232216.

DOI:10.1109/TIP.2022.3232216

Abstract

Plenoptic images and videos bearing rich information demand a tremendous amount of data storage and high transmission cost. While there has been much study on plenoptic image coding, investigations into plenoptic video coding have been very limited. We investigate the motion compensation (or so-called temporal prediction) for plenoptic video coding from a slightly different perspective by looking at the problem in the ray-space domain instead of in the conventional pixel domain. Here, we develop a novel motion compensation scheme for lenslet video under two sub-cases of ray-space motion, that is, integer ray-space motion and fractional ray-space motion. The proposed new scheme of light field motion-compensated prediction is designed such that it can be easily integrated into well-known video coding techniques such as HEVC. Experimental results compared to relevant existing methods have shown remarkable compression efficiency with an average gain of 20.03% and 21.76% respectively under "Low delayed B " and "Random Access" configurations of HEVC.

摘要

全光图像和视频包含丰富的信息，需要大量的数据存储和高传输成本。虽然已经有很多关于全光图像编码的研究，但对全光视频编码的研究却非常有限。我们从稍微不同的角度研究了全光视频编码的运动补偿（或所谓的时间预测），通过在光线空间域而不是传统的像素域中观察问题。在这里，我们研究了在两种光线空间运动的子情况下（即整数光线空间运动和分数光线空间运动）的微透镜视频的运动补偿。所提出的新的光场运动补偿预测方案设计为可以很容易地集成到著名的视频编码技术中，如 HEVC。与相关的现有方法相比，实验结果表明，在 HEVC 的“低延迟 B”和“随机访问”配置下，分别有 20.03%和 21.76%的平均增益，具有显著的压缩效率。