Li Bing, Lin Chia-Wen, Liu Shan, Huang Tiejun, Gao Wen, Kuo C-C Jay
IEEE Trans Image Process. 2020 Apr 7. doi: 10.1109/TIP.2020.2984899.
Stereo video retargeting aims at minimizing shape and depth distortions with temporal coherence in resizing a stereo video content to a desired size. Existing methods extend stereo image retargeting schemes to stereo video retargeting by adding additional temporal constraints that demand temporal coherence in all corresponding regions. However, such a straightforward extension incurs conflicts among multiple requirements (i.e., shape and depth preservation and their temporal coherence), thus failing to meet one or more of these requirements satisfactorily. To mitigate conflicts among depth, shape, and temporal constraints and avoid degrading temporal coherence perceptually, we relax temporal constraints for non-paired regions at frame boundaries, derive new temporal constraints to improve human viewing experience of a 3D scene, and propose an efficient grid-based implementation for stereo video retargeting. Experimental results demonstrate that our method achieves superior visual quality over existing methods.
立体视频重定目标旨在在将立体视频内容调整为所需大小时,通过时间连贯性来最小化形状和深度失真。现有方法通过添加额外的时间约束(要求所有对应区域的时间连贯性)将立体图像重定目标方案扩展到立体视频重定目标。然而,这种直接扩展会在多个需求(即形状和深度保留及其时间连贯性)之间引发冲突,从而无法令人满意地满足这些需求中的一个或多个。为了减轻深度、形状和时间约束之间的冲突并避免在感知上降低时间连贯性,我们放宽了帧边界处非配对区域的时间约束,推导出新的时间约束以改善3D场景的人类观看体验,并提出了一种用于立体视频重定目标的高效基于网格的实现方法。实验结果表明,我们的方法比现有方法具有更高的视觉质量。