Fu Jianting, Cao Shizhou, Cai Linqin, Yang Lechan
Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China.
School of Automation, Chongqing University of Posts and Telecommunications, Chongqing, China.
Front Comput Neurosci. 2021 Nov 11;15:770692. doi: 10.3389/fncom.2021.770692. eCollection 2021.
Finger gesture recognition (FGR) plays a crucial role in achieving, for example, artificial limb control and human-computer interaction. Currently, the most common methods of FGR are visual-based, voice-based, and surface electromyography (EMG)-based ones. Among them, surface EMG-based FGR is very popular and successful because surface EMG is a cumulative bioelectric signal from the surface of the skin that can accurately and intuitively represent the force of the fingers. However, existing surface EMG-based methods still cannot fully satisfy the required recognition accuracy for artificial limb control as the lack of high-precision sensor and high-accurate recognition model. To address this issue, this study proposes a novel FGR model that consists of sensing and classification of surface EMG signals (SC-FGR). In the proposed SC-FGR model, wireless sensors with high-precision surface EMG are first developed for acquiring multichannel surface EMG signals from the forearm. Its resolution is 16 Bits, the sampling rate is 2 kHz, the common-mode rejection ratio (CMRR) is less than 70 dB, and the short-circuit noise (SCN) is less than 1.5 μV. In addition, a convolution neural network (CNN)-based classification algorithm is proposed to achieve FGR based on acquired surface EMG signals. The CNN is trained on a spectrum map transformed from the time-domain surface EMG by continuous wavelet transform (CWT). To evaluate the proposed SC-FGR model, we compared it with seven state-of-the-art models. The experimental results demonstrate that SC-FGR achieves 97.5% recognition accuracy on eight kinds of finger gestures with five subjects, which is much higher than that of comparable models.
例如,手势识别(FGR)在实现假肢控制和人机交互等方面发挥着至关重要的作用。目前,最常见的FGR方法是基于视觉、基于语音和基于表面肌电图(EMG)的方法。其中,基于表面EMG的FGR非常流行且成功,因为表面EMG是来自皮肤表面的累积生物电信号,能够准确直观地表示手指的力量。然而,由于缺乏高精度传感器和高精度识别模型,现有的基于表面EMG的方法仍无法完全满足假肢控制所需的识别精度。为了解决这个问题,本研究提出了一种新颖的FGR模型,即表面肌电信号传感与分类(SC-FGR)模型。在所提出的SC-FGR模型中,首先开发了具有高精度表面EMG的无线传感器,用于从前臂采集多通道表面EMG信号。其分辨率为16位,采样率为2kHz,共模抑制比(CMRR)小于70dB,短路噪声(SCN)小于1.5μV。此外,还提出了一种基于卷积神经网络(CNN)的分类算法,以基于采集到的表面EMG信号实现FGR。该CNN在通过连续小波变换(CWT)从时域表面EMG变换得到的频谱图上进行训练。为了评估所提出的SC-FGR模型,我们将其与七种最先进的模型进行了比较。实验结果表明,SC-FGR在五个受试者的八种手指手势上实现了97.5%的识别准确率,远高于可比模型。