Suppr超能文献

通过深度数据优化和三维重建实现手势识别

Hand gesture recognition via deep data optimization and 3D reconstruction.

作者信息

Mustafa Zaid, Nsour Heba, Tahir Sheikh Badar Ud Din

机构信息

Department of Computer Information Systems, Prince Abdullah Bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Al-Salt, Al-Balqa, Jordan.

Department of Computer Science, Prince Abdullah Bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Salt, Al-Balqa, Jordan.

出版信息

PeerJ Comput Sci. 2023 Oct 30;9:e1619. doi: 10.7717/peerj-cs.1619. eCollection 2023.

Abstract

Hand gesture recognition (HGR) are the most significant tasks for communicating with the real-world environment. Recently, gesture recognition has been extensively utilized in diverse domains, including but not limited to virtual reality, augmented reality, health diagnosis, and robot interaction. On the other hand, accurate techniques typically utilize various modalities generated from RGB input sequences, such as optical flow which acquires the motion data in the images and videos. However, this approach impacts real-time performance due to its demand of substantial computational resources. This study aims to introduce a robust and effective approach to hand gesture recognition. We utilize two publicly available benchmark datasets. Initially, we performed preprocessing steps, including denoising, foreground extraction, and hand detection via associated component techniques. Next, hand segmentation is done to detect landmarks. Further, we utilized three multi-fused features, including geometric features, 3D point modeling and reconstruction, and angular point features. Finally, grey wolf optimization served useful features of artificial neural networks for hand gesture recognition. The experimental results have shown that the proposed HGR achieved significant recognition of 89.92% and 89.76% over IPN hand and Jester datasets, respectively.

摘要

手势识别(HGR)是与现实世界环境进行通信的最重要任务。近年来,手势识别已在包括但不限于虚拟现实、增强现实、健康诊断和机器人交互等不同领域得到广泛应用。另一方面,精确的技术通常利用从RGB输入序列生成的各种模态,例如获取图像和视频中运动数据的光流。然而,这种方法由于需要大量计算资源而影响实时性能。本研究旨在引入一种强大而有效的手势识别方法。我们使用了两个公开可用的基准数据集。首先,我们执行了预处理步骤,包括去噪、前景提取以及通过相关组件技术进行手部检测。接下来,进行手部分割以检测地标。此外,我们利用了三种多融合特征,包括几何特征、3D点建模与重建以及角点特征。最后,灰狼优化为用于手势识别的人工神经网络提供了有用的特征。实验结果表明,所提出的HGR在IPN手部数据集和Jester数据集上分别实现了89.92%和89.76%的显著识别率。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/61eb/10703008/25c8d888e8da/peerj-cs-09-1619-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验