Xing Jinrui, Yuan Hui, Hamzaoui Raouf, Liu Hao, Hou Junhui
IEEE Trans Image Process. 2023;32:6303-6317. doi: 10.1109/TIP.2023.3330086. Epub 2023 Nov 20.
In recent years, point clouds have become increasingly popular for representing three-dimensional (3D) visual objects and scenes. To efficiently store and transmit point clouds, compression methods have been developed, but they often result in a degradation of quality. To reduce color distortion in point clouds, we propose a graph-based quality enhancement network (GQE-Net) that uses geometry information as an auxiliary input and graph convolution blocks to extract local features efficiently. Specifically, we use a parallel-serial graph attention module with a multi-head graph attention mechanism to focus on important points or features and help them fuse together. Additionally, we design a feature refinement module that takes into account the normals and geometry distance between points. To work within the limitations of GPU memory capacity, the distorted point cloud is divided into overlap-allowed 3D patches, which are sent to GQE-Net for quality enhancement. To account for differences in data distribution among different color components, three models are trained for the three color components. Experimental results show that our method achieves state-of-the-art performance. For example, when implementing GQE-Net on a recent test model of the geometry-based point cloud compression (G-PCC) standard, 0.43 dB, 0.25 dB and 0.36 dB Bjφntegaard delta (BD)-peak-signal-to-noise ratio (PSNR), corresponding to 14.0%, 9.3% and 14.5% BD-rate savings were achieved on dense point clouds for the Y, Cb, and Cr components, respectively. The source code of our method is available at https://github.com/xjr998/GQE-Net.
近年来,点云在表示三维(3D)视觉对象和场景方面越来越受欢迎。为了有效地存储和传输点云,人们开发了压缩方法,但这些方法往往会导致质量下降。为了减少点云中的颜色失真,我们提出了一种基于图的质量增强网络(GQE-Net),该网络使用几何信息作为辅助输入,并通过图卷积块有效地提取局部特征。具体来说,我们使用具有多头图注意力机制的并行-串行图注意力模块来关注重要的点或特征,并帮助它们融合在一起。此外,我们设计了一个特征细化模块,该模块考虑了点之间的法线和几何距离。为了在GPU内存容量的限制下工作,将失真的点云划分为允许重叠的3D块,然后将这些块发送到GQE-Net进行质量增强。为了考虑不同颜色分量之间的数据分布差异,针对三个颜色分量训练了三个模型。实验结果表明,我们的方法达到了当前的最优性能。例如,在基于几何的点云压缩(G-PCC)标准的最新测试模型上实现GQE-Net时,对于密集点云的Y、Cb和Cr分量,分别实现了0.43 dB、0.25 dB和0.36 dB的Bjφntegaard增量(BD)-峰值信噪比(PSNR),对应的BD速率节省分别为14.0%、9.3%和14.5%。我们方法的源代码可在https://github.com/xjr998/GQE-Net获取。