School of Artificial Intelligence, North China University of Science and Technology, 063210 Tangshan, China.
Hebei Key Laboratory of Industrial Intelligent Perception, Tangshan 063210, China.
Rev Sci Instrum. 2024 Jan 1;95(1). doi: 10.1063/5.0181265.
The traditional algorithms for generating 3D human point clouds often face challenges in dealing with issues such as phantom targets and target classification caused by electromagnetic multipath effects, resulting in a lack of accuracy in the generated point clouds and requiring manual labeling of the position of the human body. To address these problems, this paper proposes an adaptive method for generating 3D human point clouds based on 4D millimeter-wave radar (Self-Adaptive mPoint, SA-mPoint). This method estimates the rough human point cloud by considering micro-motion and respiration characteristics while combining the echo dynamic with static information. Furthermore, it enhances the density of point cloud generation. It reduces interference from multipath noise through multi-frame dynamic fusion and an adaptive density-based clustering algorithm based on the center points of humans. The effectiveness of the SA-mPoint algorithm is verified through experiments conducted using the TI Millimeter Wave Cascade Imaging Radar Radio Frequency Evaluation Module 77G 4D cascade radar to collect challenging raw data consisting of single-target and multi-target human poses in an open classroom setting. Experimental results demonstrate that the proposed algorithm achieves an average accuracy rate of 97.94% for generating point clouds. Compared to the popular TI-mPoint algorithm, it generates a higher number of point clouds on average (increased by 87.94%), improves the average accuracy rate for generating point clouds (increased by 78.3%), and reduces the running time on average (reduced by 11.41%). This approach exhibits high practicality and promising application prospects.
传统的生成 3D 人体点云的算法在处理由电磁多径效应引起的幻影目标和目标分类等问题时常常面临挑战,导致生成的点云精度不足,需要手动标记人体位置。针对这些问题,本文提出了一种基于 4D 毫米波雷达的自适应生成 3D 人体点云的方法(Self-Adaptive mPoint,SA-mPoint)。该方法通过结合回波动态与静态信息,考虑微运动和呼吸特征来估计人体的粗略点云,并增强点云生成的密度。通过多帧动态融合和基于人体中心点的自适应密度聚类算法,减少多径噪声的干扰。使用 TI 毫米波级联成像雷达射频评估模块 77G 4D 级联雷达收集的具有挑战性的原始数据进行实验,证明了 SA-mPoint 算法的有效性,这些原始数据包括在开放教室环境中单目标和多目标人体姿势。实验结果表明,该算法对点云生成的平均准确率达到 97.94%。与流行的 TI-mPoint 算法相比,它平均生成更多的点云(增加了 87.94%),提高了生成点云的平均准确率(增加了 78.3%),并平均减少了运行时间(减少了 11.41%)。该方法具有很高的实用性和广阔的应用前景。