Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.
IEEE Trans Image Process. 2013 Sep;22(9):3497-512. doi: 10.1109/TIP.2013.2265883. Epub 2013 Jun 3.
In this paper, we propose a view synthesis distortion model (VSDM) that establishes the relationship between depth distortion and view synthesis distortion for the regions with different characteristics: color texture area corresponding depth (CTAD) region and color smooth area corresponding depth (CSAD), respectively. With this VSDM, we propose regional bit allocation (RBA) and rate distortion optimization (RDO) algorithms for multiview depth video coding (MDVC) by allocating more bits on CTAD for rendering quality and fewer bits on CSAD for compression efficiency. Experimental results show that the proposed VSDM based RBA and RDO can improve the coding efficiency significantly for the test sequences. In addition, for the proposed overall MDVC algorithm that integrates VSDM based RBA and RDO, it achieves 9.99% and 14.51% bit rate reduction on average for the high and low bit rate, respectively. It can improve virtual view image quality 0.22 and 0.24 dB on average at the high and low bit rate, respectively, when compared with the original joint multiview video coding model. The RD performance comparisons using five different metrics also validate the effectiveness of the proposed overall algorithm. In addition, the proposed algorithms can be applied to both INTRA and INTER frames.
在本文中，我们提出了一种视差合成失真模型（VSDM），分别为具有不同特征的区域（即颜色纹理对应深度（CTAD）区域和颜色平滑对应深度（CSAD）区域）建立了深度失真与视差合成失真之间的关系。利用该 VSDM，我们提出了多视点深度视频编码（MDVC）的区域比特分配（RBA）和率失真优化（RDO）算法，通过在 CTAD 上分配更多的比特以提高渲染质量，在 CSAD 上分配更少的比特以提高压缩效率。实验结果表明，所提出的基于 VSDM 的 RBA 和 RDO 可以显著提高测试序列的编码效率。此外，对于集成了基于 VSDM 的 RBA 和 RDO 的整体 MDVC 算法，它在高和低比特率下平均分别减少了 9.99%和 14.51%的比特率。与原始联合多视点视频编码模型相比，它在高和低比特率下分别平均提高了 0.22 和 0.24dB 的虚拟视图图像质量。使用五种不同度量标准的 RD 性能比较也验证了所提出的整体算法的有效性。此外，所提出的算法可应用于 INTRA 和 INTER 帧。
