Than Nhat-Minh, Nguyen Son-Thuy, Huynh Dang-Nguyen, Tran Thao-Nguyen, Le Nguyen-Khoa, Mai Huu-Xuan, Le Cao-Dang, Pham Tan-Thi, Huynh Quang-Linh, Nguyen Trung-Hau
Department of Biomedical Engineering, Faculty of Applied Science, Ho Chi Minh City University of Technology (HCMUT), 268 Ly Thuong Kiet, District 10, Ho Chi Minh City, 700000, Vietnam.
Vietnam National University Ho Chi Minh City, Linh Trung Ward, Thu Duc District, Ho Chi Minh City, 700000, Vietnam.
Sci Rep. 2024 Dec 30;14(1):31830. doi: 10.1038/s41598-024-83108-w.
This study addresses the growing importance of hand gesture recognition across diverse fields, such as industry, education, and healthcare, targeting the often-neglected needs of the deaf and dumb community. The primary objective is to improve communication between individuals, thereby enhancing the overall quality of life, particularly in the context of advanced healthcare. This paper presents a novel approach for real-time hand gesture recognition using bio-impedance techniques. The developed device, powered by a Raspberry Pi and connected to electrodes for impedance data acquisition, employs an impedance chip for data collection. To categorize hand gestures, Convolutional Neuron Network (CNN), XGBoost, and Random Forest were used. The model successfully recognized up to nine distinct gestures, achieving an average accuracy of 97.24% across ten subjects using a subject-dependent strategy, showcasing the efficacy of the bioimpedance-based system in hand gesture recognition. The promising results lay a foundation for future developments in nonverbal communication between humans and machines as it contributes to the advancement of technology for the benefit of individuals with hearing impairments, addressing a critical social need.
本研究探讨了手势识别在工业、教育和医疗等多个领域日益增长的重要性,针对聋哑群体常常被忽视的需求。主要目标是改善个体之间的沟通,从而提高整体生活质量,特别是在先进医疗保健的背景下。本文提出了一种使用生物阻抗技术进行实时手势识别的新方法。所开发的设备由树莓派供电,并连接到电极以采集阻抗数据,采用阻抗芯片进行数据收集。为了对手势进行分类,使用了卷积神经网络(CNN)、XGBoost和随机森林。该模型成功识别了多达九种不同的手势,采用依赖于受试者的策略,在十名受试者中平均准确率达到97.24%,展示了基于生物阻抗的系统在手势识别中的有效性。这些有前景的结果为未来人机之间非语言通信的发展奠定了基础,因为它有助于推动技术进步,造福听力受损者,满足一项关键的社会需求。