Graduate School of Automotive Engineering, Kookmin University, Seoul 02707, Republic of Korea.
Department of Automobile and IT Convergence, Kookmin University, Seoul 02707, Republic of Korea.
Sensors (Basel). 2022 Nov 29;22(23):9308. doi: 10.3390/s22239308.
Recently, research using point clouds has been increasing with the development of 3D scanner technology. According to this trend, the demand for high-quality point clouds is increasing, but there is still a problem with the high cost of obtaining high-quality point clouds. Therefore, with the recent remarkable development of deep learning, point cloud up-sampling research, which uses deep learning to generate high-quality point clouds from low-quality point clouds, is one of the fields attracting considerable attention. This paper proposes a new point cloud up-sampling method called Point cloud Up-sampling via Multi-scale Features Attention (PU-MFA). Inspired by prior studies that reported good performance at generating high-quality dense point set using the multi-scale features or attention mechanisms, PU-MFA merges the two through a U-Net structure. In addition, PU-MFA adaptively uses multi-scale features to refine the global features effectively. The PU-MFA was compared with other state-of-the-art methods in various evaluation metrics through various experiments using the PU-GAN dataset, which is a synthetic point cloud dataset, and the KITTI dataset, which is the real-scanned point cloud dataset. In various experimental results, PU-MFA showed superior performance of generating high-quality dense point set in quantitative and qualitative evaluation compared to other state-of-the-art methods, proving the effectiveness of the proposed method. The attention map of PU-MFA was also visualized to show the effect of multi-scale features.
近年来,随着 3D 扫描仪技术的发展,使用点云的研究不断增加。根据这一趋势,对高质量点云的需求不断增加,但获取高质量点云的成本仍然很高。因此,随着深度学习的最新显著发展,使用深度学习从低质量点云生成高质量点云的点云上采样研究是一个备受关注的领域。本文提出了一种新的点云上采样方法,称为基于多尺度特征注意力的点云上采样(PU-MFA)。受先前研究的启发,这些研究报告了使用多尺度特征或注意力机制生成高质量密集点集的良好性能,PU-MFA 通过 U-Net 结构合并了这两者。此外,PU-MFA 自适应地使用多尺度特征来有效地细化全局特征。通过使用 PU-GAN 数据集(合成点云数据集)和 KITTI 数据集(真实扫描点云数据集)进行的各种实验,将 PU-MFA 与其他最先进的方法在各种评估指标进行了比较。在各种实验结果中,与其他最先进的方法相比,PU-MFA 在生成高质量密集点集的定量和定性评估中表现出了优越的性能,证明了所提出方法的有效性。还可视化了 PU-MFA 的注意力图,以显示多尺度特征的效果。