School of Electrical Engineering and Automation, Hefei University of Technology, Hefei, 230009, China; Graduate School of Medicine, Juntendo University, Tokyo, 1138421, Japan.
School of Electrical Engineering and Automation, Hefei University of Technology, Hefei, 230009, China; Industrial Automation Engineering Technology Research Center of Anhui Province, Hefei, 230009, China.
Artif Intell Med. 2024 Mar;149:102777. doi: 10.1016/j.artmed.2024.102777. Epub 2024 Jan 17.
Accurate finger gesture recognition with surface electromyography (sEMG) is essential and long-challenge in the muscle-computer interface, and many high-performance deep learning models have been developed to predict gestures. For these models, problem-specific tuning of network architecture is essential for improving the performance, yet it requires substantial knowledge of network architecture design and commitment of time and effort. This process thus imposes a major obstacle to the widespread and flexible application of modern deep learning. To address this issue, we present an auto-learning search framework (ALSF) to generate the integrated block-wised neural network (IBWNN) for sEMG-based gesture recognition. IBWNN contains several feature extraction blocks and dimensional reduction layers, and each feature extraction block integrates two sub-blocks (i.e., multi-branch convolutional block and triplet attention block). Meanwhile, ALSF generates optimal models for gesture recognition through the reinforcement learning method. The results show that the generated models yield state-of-the-art results compared to the modern popular networks on the open dataset Ninapro DB5. Moreover, compared to other networks, the generated models have fewer parameters and can be deployed in practical applications with less resource consumption.
利用表面肌电图 (sEMG) 进行准确的手指手势识别是肌肉计算机接口中的一个重要且长期存在的挑战,为此已经开发了许多高性能的深度学习模型来预测手势。对于这些模型,网络架构的特定于问题的调整对于提高性能至关重要,但这需要对网络架构设计有大量的了解,并需要投入时间和精力。因此,这个过程给现代深度学习的广泛和灵活应用带来了重大障碍。为了解决这个问题,我们提出了一种自动学习搜索框架 (ALSF) 来生成用于基于 sEMG 的手势识别的集成块式神经网络 (IBWNN)。IBWNN 包含几个特征提取块和降维层,每个特征提取块集成两个子块(即多分支卷积块和三重注意块)。同时,ALSF 通过强化学习方法为手势识别生成最佳模型。结果表明,与开放数据集 Ninapro DB5 上的现代流行网络相比,生成的模型在手势识别方面取得了最先进的结果。此外,与其他网络相比,生成的模型具有更少的参数,可以在实际应用中以较少的资源消耗进行部署。