School of Software Engineering, Huazhong University of Science and Technology, Wuhan 430074, China.
Ezhou Institute of Engineering, Huazhong University of Science and Technology, Ezhou 436000, China.
Sensors (Basel). 2020 Feb 16;20(4):1074. doi: 10.3390/s20041074.
Real-time sensing and modeling of the human body, especially the hands, is an important research endeavor for various applicative purposes such as in natural human computer interactions. Hand pose estimation is a big academic and technical challenge due to the complex structure and dexterous movement of human hands. Boosted by advancements from both hardware and artificial intelligence, various prototypes of data gloves and computer-vision-based methods have been proposed for accurate and rapid hand pose estimation in recent years. However, existing reviews either focused on data gloves or on vision methods or were even based on a particular type of camera, such as the depth camera. The purpose of this survey is to conduct a comprehensive and timely review of recent research advances in sensor-based hand pose estimation, including wearable and vision-based solutions. Hand kinematic models are firstly discussed. An in-depth review is conducted on data gloves and vision-based sensor systems with corresponding modeling methods. Particularly, this review also discusses deep-learning-based methods, which are very promising in hand pose estimation. Moreover, the advantages and drawbacks of the current hand gesture estimation methods, the applicative scope, and related challenges are also discussed.
实时感知和建模人体,尤其是手部,对于各种应用目的(如自然人机交互)来说是一项重要的研究工作。由于人手结构复杂、运动灵活,手姿势估计是一个具有挑战性的学术和技术难题。近年来,得益于硬件和人工智能的进步,已经提出了各种数据手套和基于计算机视觉的原型,用于准确快速地进行手姿势估计。然而,现有的综述要么专注于数据手套,要么专注于视觉方法,甚至是基于特定类型的相机,如深度相机。本调查的目的是对基于传感器的手姿势估计的最新研究进展进行全面和及时的综述,包括可穿戴和基于视觉的解决方案。首先讨论了手部运动学模型。深入回顾了数据手套和基于视觉的传感器系统及其相应的建模方法。特别是,本综述还讨论了基于深度学习的方法,这些方法在手姿势估计中非常有前景。此外,还讨论了当前手势估计方法的优缺点、适用范围和相关挑战。