基于点云的深度学习及其应用:综述。
Deep Learning on Point Clouds and Its Application: A Survey.
机构信息
School of Mathematics and Statistics, Wuhan University, Wuhan 430072, China.
Institute of Automation, Chinese Academy of Sciences, Beijing 10090, China.
出版信息
Sensors (Basel). 2019 Sep 26;19(19):4188. doi: 10.3390/s19194188.
Point cloud is a widely used 3D data form, which can be produced by depth sensors, such as Light Detection and Ranging (LIDAR) and RGB-D cameras. Being unordered and irregular, many researchers focused on the feature engineering of the point cloud. Being able to learn complex hierarchical structures, deep learning has achieved great success with images from cameras. Recently, many researchers have adapted it into the applications of the point cloud. In this paper, the recent existing point cloud feature learning methods are classified as point-based and tree-based. The former directly takes the raw point cloud as the input for deep learning. The latter first employs a k-dimensional tree (Kd-tree) structure to represent the point cloud with a regular representation and then feeds these representations into deep learning models. Their advantages and disadvantages are analyzed. The applications related to point cloud feature learning, including 3D object classification, semantic segmentation, and 3D object detection, are introduced, and the datasets and evaluation metrics are also collected. Finally, the future research trend is predicted.
点云是一种广泛使用的 3D 数据形式,可以通过深度传感器(如激光雷达(LIDAR)和 RGB-D 相机)生成。由于无序和不规则,许多研究人员专注于点云的特征工程。深度学习能够学习复杂的层次结构,因此在相机拍摄的图像方面取得了巨大的成功。最近,许多研究人员将其应用于点云的应用中。在本文中,将现有的点云特征学习方法分为基于点和基于树的方法。前者直接将原始点云作为深度学习的输入。后者首先采用 k 维树(Kd-tree)结构对点云进行正则化表示,然后将这些表示输入到深度学习模型中。分析了它们的优缺点。介绍了与点云特征学习相关的应用,包括 3D 目标分类、语义分割和 3D 目标检测,并收集了相关数据集和评估指标。最后,预测了未来的研究趋势。