School of Design Arts and Media, Nanjing University of Science and Technology, Nanjing, Jiangsu Province, China.
School of Instrument Science and Engineering, Southeast University, Nanjing, Jiangsu Province, China.
Comput Intell Neurosci. 2021 Dec 29;2021:4454648. doi: 10.1155/2021/4454648. eCollection 2021.
As a machine-learning-driven decision-making problem, the surface electromyography (sEMG)-based hand movement recognition is one of the key issues in robust control of noninvasive neural interfaces such as myoelectric prosthesis and rehabilitation robot. Despite the recent success in sEMG-based hand movement recognition using end-to-end deep feature learning technologies based on deep learning models, the performance of today's sEMG-based hand movement recognition system is still limited by the noisy, random, and nonstationary nature of sEMG signals and researchers have come up with a number of methods that improve sEMG-based hand movement via feature engineering. Aiming at achieving higher sEMG-based hand movement recognition accuracies while enabling a trade-off between performance and computational complexity, this study proposed a progressive fusion network (PFNet) framework, which improves sEMG-based hand movement recognition via integration of domain knowledge-guided feature engineering and deep feature learning. In particular, it learns high-level feature representations from raw sEMG signals and engineered time-frequency domain features via a feature learning network and a domain knowledge network, respectively, and then employs a 3-stage progressive fusion strategy to progressively fuse the two networks together and obtain the final decisions. Extensive experiments were conducted on five sEMG datasets to evaluate our proposed PFNet, and the experimental results showed that the proposed PFNet could achieve the average hand movement recognition accuracies of 87.8%, 85.4%, 68.3%, 71.7%, and 90.3% on the five datasets, respectively, which outperformed those achieved by the state of the arts.
作为一个机器学习驱动的决策问题,基于表面肌电信号 (sEMG) 的手运动识别是神经接口稳健控制的关键问题之一,例如肌电假肢和康复机器人。尽管基于深度学习模型的端到端深度特征学习技术在基于 sEMG 的手运动识别方面取得了最新的成功,但当今基于 sEMG 的手运动识别系统的性能仍然受到 sEMG 信号的噪声、随机性和非平稳性的限制,研究人员已经提出了许多通过特征工程来改善基于 sEMG 的手运动的方法。本研究旨在在性能和计算复杂性之间实现更高的基于 sEMG 的手运动识别精度,提出了一种渐进式融合网络 (PFNet) 框架,通过整合基于领域知识的特征工程和深度特征学习来提高基于 sEMG 的手运动识别性能。具体来说,它通过特征学习网络和领域知识网络分别从原始 sEMG 信号和工程的时频域特征中学习高级特征表示,然后采用 3 级渐进式融合策略将两个网络逐步融合在一起并得出最终决策。在五个 sEMG 数据集上进行了广泛的实验来评估我们提出的 PFNet,实验结果表明,所提出的 PFNet 在五个数据集上的平均手运动识别准确率分别为 87.8%、85.4%、68.3%、71.7%和 90.3%,优于现有技术的准确率。