Mobarak Rami, Zhang Shen, Zhou Hao, Mengarelli Alessandro, Verdini Federica, Burattini Laura, Tigrini Andrea, Alici Gursel
Department of Information Engineering, Universitá Politecnica delle Marche, Via Brecce Bianche, 12, 60131 Ancona, Italy.
School of Mechanical, Materials, Mechatronic and Biomedical Engineering, University of Wollongong, Wollongong, NSW 2522, Australia.
J Neural Eng. 2025 Aug 14;22(4). doi: 10.1088/1741-2552/adf888.
. Surface electromyography (sEMG) and pressure-based force myography (pFMG) are two complementary modalities adopted in hand gesture recognition due to their ability to capture muscle electrical and mechanical activity, respectively. While sEMG carries rich neural information about the intended gestures and has long been established as the primary control signal in myoelectric interfaces, pFMG has recently emerged as a stable modality that is less sensitive to sweat and can indicate motion onset earlier than sEMG, making their fusion promising for robust pattern recognition. However, gesture classification systems based on these signals often suffer from performance degradation due to limb position changes, which affect signal characteristics.. To address this, we introduce MyoPose, a novel and lightweight spatial synergy-based feature set for enhancing neuromechanical control. MyoPose works on effectively decoding colocated sEMG-pFMG information to improve hand gesture recognition under limb position variability while remaining computationally efficient for resource-constrained hardware.. The proposed MyoPose feature combined with linear discriminant analysis, achieved 87.7% accuracy (ACC) in a nine-hand gesture recognition task, outperforming standard myoelectric feature sets and comparable to a state-of-the-art decision-level multimodal fusion parallel convolutional neural network. Notably, MyoPose maintained computational efficiency, achieving real-time feasibility with an estimated controller delay of 110.62 ms, well within the operational requirement of 100-125 ms, as well as ultra-light memory requirement of 0.011 KB.. The novelty of this study lies in providing an effective feature set for multimodal driven hand gesture recognition, handling limb position variations with robust ACC, and showing potential for real-time feasibility for human-machine interfaces without the need for deep learning.
表面肌电图(sEMG)和基于压力的力肌电图(pFMG)是用于手势识别的两种互补模式,因为它们分别能够捕捉肌肉的电活动和机械活动。虽然sEMG携带有关预期手势的丰富神经信息,并且长期以来一直被确立为肌电接口中的主要控制信号,但pFMG最近已成为一种稳定的模式,对汗液不太敏感,并且可以比sEMG更早地指示运动开始,这使得它们的融合有望实现强大的模式识别。然而,基于这些信号的手势分类系统通常会由于肢体位置变化而导致性能下降,这会影响信号特征。为了解决这个问题,我们引入了MyoPose,这是一种新颖且轻量级的基于空间协同作用的特征集,用于增强神经机械控制。MyoPose致力于有效解码并置的sEMG-pFMG信息,以改善肢体位置变化情况下的手势识别,同时对于资源受限的硬件保持计算效率。所提出的MyoPose特征与线性判别分析相结合,在九手势识别任务中达到了87.7%的准确率(ACC),优于标准肌电特征集,并且与先进的决策级多模态融合并行卷积神经网络相当。值得注意的是,MyoPose保持了计算效率,以估计的110.62毫秒控制器延迟实现了实时可行性,完全在100-125毫秒的操作要求范围内,以及0.011 KB的超轻内存要求。这项研究的新颖之处在于为多模态驱动的手势识别提供了一种有效的特征集,以强大的ACC处理肢体位置变化,并展示了无需深度学习即可实现人机接口实时可行性的潜力。