Mustafa Zaid, Nsour Heba, Tahir Sheikh Badar Ud Din
Department of Computer Information Systems, Prince Abdullah Bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Al-Salt, Al-Balqa, Jordan.
Department of Computer Science, Prince Abdullah Bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Salt, Al-Balqa, Jordan.
PeerJ Comput Sci. 2023 Oct 30;9:e1619. doi: 10.7717/peerj-cs.1619. eCollection 2023.
Hand gesture recognition (HGR) are the most significant tasks for communicating with the real-world environment. Recently, gesture recognition has been extensively utilized in diverse domains, including but not limited to virtual reality, augmented reality, health diagnosis, and robot interaction. On the other hand, accurate techniques typically utilize various modalities generated from RGB input sequences, such as optical flow which acquires the motion data in the images and videos. However, this approach impacts real-time performance due to its demand of substantial computational resources. This study aims to introduce a robust and effective approach to hand gesture recognition. We utilize two publicly available benchmark datasets. Initially, we performed preprocessing steps, including denoising, foreground extraction, and hand detection via associated component techniques. Next, hand segmentation is done to detect landmarks. Further, we utilized three multi-fused features, including geometric features, 3D point modeling and reconstruction, and angular point features. Finally, grey wolf optimization served useful features of artificial neural networks for hand gesture recognition. The experimental results have shown that the proposed HGR achieved significant recognition of 89.92% and 89.76% over IPN hand and Jester datasets, respectively.
手势识别(HGR)是与现实世界环境进行通信的最重要任务。近年来,手势识别已在包括但不限于虚拟现实、增强现实、健康诊断和机器人交互等不同领域得到广泛应用。另一方面,精确的技术通常利用从RGB输入序列生成的各种模态,例如获取图像和视频中运动数据的光流。然而,这种方法由于需要大量计算资源而影响实时性能。本研究旨在引入一种强大而有效的手势识别方法。我们使用了两个公开可用的基准数据集。首先,我们执行了预处理步骤,包括去噪、前景提取以及通过相关组件技术进行手部检测。接下来,进行手部分割以检测地标。此外,我们利用了三种多融合特征,包括几何特征、3D点建模与重建以及角点特征。最后,灰狼优化为用于手势识别的人工神经网络提供了有用的特征。实验结果表明,所提出的HGR在IPN手部数据集和Jester数据集上分别实现了89.92%和89.76%的显著识别率。