Zhang Yujie, Yang Qi, Xu Yiling, Liu Shan
IEEE Trans Image Process. 2024;33:5755-5770. doi: 10.1109/TIP.2024.3468893. Epub 2024 Oct 15.
Full-reference point cloud quality assessment (FR-PCQA) aims to infer the quality of distorted point clouds with available references. Most of the existing FR-PCQA metrics ignore the fact that the human visual system (HVS) dynamically tackles visual information according to different distortion levels (i.e., distortion detection for high-quality samples and appearance perception for low-quality samples) and measure point cloud quality using unified features. To bridge the gap, in this paper, we propose a perception-guided hybrid metric (PHM) that adaptively leverages two visual strategies with respect to distortion degree to predict point cloud quality: to measure visible difference in high-quality samples, PHM takes into account the masking effect and employs texture complexity as an effective compensatory factor for absolute difference; on the other hand, PHM leverages spectral graph theory to evaluate appearance degradation in low-quality samples. Variations in geometric signals on graphs and changes in the spectral graph wavelet coefficients are utilized to characterize geometry and texture appearance degradation, respectively. Finally, the results obtained from the two components are combined in a non-linear method to produce an overall quality score of the tested point cloud. The results of the experiment on five independent databases show that PHM achieves state-of-the-art (SOTA) performance and offers significant performance improvement in multiple distortion environments. The code is publicly available at https://github.com/zhangyujie-1998/PHM.
全参考点云质量评估(FR-PCQA)旨在利用可用参考来推断失真点云的质量。大多数现有的FR-PCQA指标忽略了人类视觉系统(HVS)会根据不同失真水平动态处理视觉信息这一事实(即对高质量样本进行失真检测,对低质量样本进行外观感知),并使用统一特征来测量点云质量。为了弥补这一差距,在本文中,我们提出了一种感知引导混合指标(PHM),该指标根据失真程度自适应地利用两种视觉策略来预测点云质量:为了测量高质量样本中的可见差异,PHM考虑了掩蔽效应,并将纹理复杂度用作绝对差异的有效补偿因子;另一方面,PHM利用谱图理论来评估低质量样本中的外观退化。图上几何信号的变化和谱图小波系数的变化分别用于表征几何和纹理外观退化。最后,将两个组件获得的结果以非线性方法组合,以生成被测点云的整体质量得分。在五个独立数据库上的实验结果表明,PHM实现了当前最优(SOTA)性能,并且在多种失真环境中提供了显著的性能提升。代码可在https://github.com/zhangyujie-1998/PHM上公开获取。