Suppr超能文献

基于多视角估计时间人体姿态的 3D 静态点云配准

3D Static Point Cloud Registration by Estimating Temporal Human Pose at Multiview.

机构信息

Department of Electronic Materials Engeering, Kwangwoon University, Kwangwoon-ro 20, Nowon-gu, Seoul 01897, Korea.

Yeshcompany, 18, Teheran-ro 43-gil, Gangnam-gu, Seoul 06151, Korea.

出版信息

Sensors (Basel). 2022 Jan 31;22(3):1097. doi: 10.3390/s22031097.

Abstract

This paper proposes a new technique for performing 3D static-point cloud registration after calibrating a multi-view RGB-D camera using a 3D (dimensional) joint set. Consistent feature points are required to calibrate a multi-view camera, and accurate feature points are necessary to obtain high-accuracy calibration results. In general, a special tool, such as a chessboard, is used to calibrate a multi-view camera. However, this paper uses joints on a human skeleton as feature points for calibrating a multi-view camera to perform calibration efficiently without special tools. We propose an RGB-D-based calibration algorithm that uses the joint coordinates of the 3D joint set obtained through pose estimation as feature points. Since human body information captured by the multi-view camera may be incomplete, a joint set predicted based on image information obtained through this may be incomplete. After efficiently integrating a plurality of incomplete joint sets into one joint set, multi-view cameras can be calibrated by using the combined joint set to obtain extrinsic matrices. To increase the accuracy of calibration, multiple joint sets are used for optimization through temporal iteration. We prove through experiments that it is possible to calibrate a multi-view camera using a large number of incomplete joint sets.

摘要

本文提出了一种新的技术,用于在使用 3D(维度)联合集校准多视角 RGB-D 相机后执行 3D 静态点云配准。校准多视角相机需要一致的特征点,并且需要准确的特征点才能获得高精度的校准结果。通常,使用特殊工具(如棋盘)来校准多视角相机。但是,本文使用人体骨骼上的关节作为特征点来校准多视角相机,从而无需特殊工具即可高效进行校准。我们提出了一种基于 RGB-D 的校准算法,该算法使用通过姿势估计获得的 3D 联合集中的关节坐标作为特征点。由于通过多视角相机捕获的人体信息可能不完整,因此基于通过该信息获得的图像信息预测的关节集可能不完整。在将多个不完整的关节集高效地集成到一个关节集中之后,可以使用组合关节集通过使用外参矩阵来校准多视角相机。为了提高校准的准确性,通过时间迭代对多个关节集进行优化。我们通过实验证明,使用大量不完整的关节集可以校准多视角相机。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4a19/8839544/c488ca49a780/sensors-22-01097-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验