School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, Hubei, China.
Comput Intell Neurosci. 2020 Sep 9;2020:8871605. doi: 10.1155/2020/8871605. eCollection 2020.
In this paper, a fusion method based on multiple features and hidden Markov model (HMM) is proposed for recognizing dynamic hand gestures corresponding to an operator's instructions in robot teleoperation. In the first place, a valid dynamic hand gesture from continuously obtained data according to the velocity of the moving hand needs to be separated. Secondly, a feature set is introduced for dynamic hand gesture expression, which includes four sorts of features: palm posture, bending angle, the opening angle of the fingers, and gesture trajectory. Finally, HMM classifiers based on these features are built, and a weighted calculation model fusing the probabilities of four sorts of features is presented. The proposed method is evaluated by recognizing dynamic hand gestures acquired by leap motion (LM), and it reaches recognition rates of about 90.63% for LM-Gesture3D dataset created by the paper and 93.3% for Letter-gesture dataset, respectively.
本文提出了一种基于多特征和隐马尔可夫模型(HMM)的融合方法,用于识别机器人遥操作中对应于操作员指令的动态手势。首先,根据移动手的速度,从连续获得的数据中分离出有效的动态手势。其次,引入了一组用于动态手势表达的特征集,包括手掌姿势、弯曲角度、手指张开角度和手势轨迹等四种特征。最后,基于这些特征构建 HMM 分类器,并提出了一种融合四种特征概率的加权计算模型。通过识别 leap motion(LM)采集的动态手势对所提出的方法进行评估,对于由本文创建的 LM-Gesture3D 数据集,识别率约为 90.63%,对于 Letter-gesture 数据集,识别率约为 93.3%。