Lu Zhuheng, Mao Weiwei, Dai Yuewei, Li Weiqing, Su Zhiyong
IEEE Trans Vis Comput Graph. 2022 Dec;28(12):4172-4185. doi: 10.1109/TVCG.2021.3082572. Epub 2022 Oct 26.
Multiple cylinders detection from large-scale and complex point clouds is a historical but challenging problem, considering the efficiency and accuracy. We propose a novel framework, named slicing-tracking-detection (STD), that detects multiple cylinders accurately and simultaneously from point clouds of large-scale and complex process plants. In this framework, the 3D cylinder detection problem is reformulated as a cylinder ingredients tracking task based on multi-object tracking (MOT). First, we generate slices from the input point cloud, and render them to slice sequence. Then, the cycle of a cylinder is modeled with a Markov Decision Process (MDP), where the ingredient is tracked with a template and the miss tracking is associated with ingredient proposals through reinforcement learning. Finally, by applying MDP for each cylinder, multiple cylinders can be detected simultaneously and accurately. Extensive experiments show that the proposed STD framework can significantly outperform the state-of-the-art approaches in efficiency, accuracy, and robustness. The source code is available at http://zhiyongsu.github.io.
考虑到效率和准确性,从大规模复杂点云中检测多个圆柱体是一个由来已久但颇具挑战性的问题。我们提出了一种名为切片 - 跟踪 - 检测(STD)的新颖框架,该框架能够从大规模复杂加工厂的点云中准确且同时地检测多个圆柱体。在此框架中,三维圆柱体检测问题被重新表述为基于多目标跟踪(MOT)的圆柱体成分跟踪任务。首先,我们从输入点云生成切片,并将其渲染为切片序列。然后,利用马尔可夫决策过程(MDP)对圆柱体的周期进行建模,其中通过模板跟踪成分,并通过强化学习将跟踪失败与成分提议相关联。最后,通过对每个圆柱体应用MDP,可以同时准确地检测多个圆柱体。大量实验表明,所提出的STD框架在效率、准确性和鲁棒性方面能够显著优于现有最先进的方法。源代码可在http://zhiyongsu.github.io获取。