Chen Chin-Sheng, Chen Po-Chun, Hsu Chih-Ming
Graduate Institute of Automation Technology, National Taipei University of Technology, Taipei 106, Taiwan.
Department of Mechanical Engineering, National Taipei University of Technology, Taipei 106, Taiwan.
Sensors (Basel). 2016 Nov 23;16(11):1969. doi: 10.3390/s16111969.
This paper presents a novel 3D feature descriptor for object recognition and to identify poses when there are six-degrees-of-freedom for mobile manipulation and grasping applications. Firstly, a Microsoft Kinect sensor is used to capture 3D point cloud data. A viewpoint feature histogram (VFH) descriptor for the 3D point cloud data then encodes the geometry and viewpoint, so an object can be simultaneously recognized and registered in a stable pose and the information is stored in a database. The VFH is robust to a large degree of surface noise and missing depth information so it is reliable for stereo data. However, the pose estimation for an object fails when the object is placed symmetrically to the viewpoint. To overcome this problem, this study proposes a modified viewpoint feature histogram (MVFH) descriptor that consists of two parts: a surface shape component that comprises an extended fast point feature histogram and an extended viewpoint direction component. The MVFH descriptor characterizes an object's pose and enhances the system's ability to identify objects with mirrored poses. Finally, the refined pose is further estimated using an iterative closest point when the object has been recognized and the pose roughly estimated by the MVFH descriptor and it has been registered on a database. The estimation results demonstrate that the MVFH feature descriptor allows more accurate pose estimation. The experiments also show that the proposed method can be applied in vision-guided robotic grasping systems.
本文提出了一种新颖的3D特征描述符,用于物体识别以及在移动操纵和抓取应用存在六自由度的情况下识别姿态。首先,使用微软Kinect传感器捕获3D点云数据。然后,针对3D点云数据的视点特征直方图(VFH)描述符对几何形状和视点进行编码,这样就能以稳定姿态同时识别和配准物体,并将信息存储在数据库中。VFH在很大程度上对表面噪声和深度信息缺失具有鲁棒性,因此对立体数据很可靠。然而,当物体相对于视点对称放置时,物体的姿态估计会失败。为克服这一问题,本研究提出了一种改进的视点特征直方图(MVFH)描述符,它由两部分组成:一个表面形状组件,包括扩展的快速点特征直方图;一个扩展的视点方向组件。MVFH描述符表征物体的姿态,并增强了系统识别具有镜像姿态物体的能力。最后,当物体已被识别且姿态由MVFH描述符大致估计并已注册到数据库中时,使用迭代最近点进一步估计精确姿态。估计结果表明,MVFH特征描述符能实现更精确的姿态估计。实验还表明,所提出的方法可应用于视觉引导的机器人抓取系统。