Li Jixiang, Shi Wuxiang, Li Yurong
College of Electrical Engineering and Automation, Fuzhou University, Fuzhou,, 350108 Fujian China.
Fujian Provincial Key Laboratory of Medical Instrument and Pharmaceutical Technology, Fuzhou University, Fuzhou, 350108 Fujian China.
Cogn Neurodyn. 2024 Oct;18(5):2689-2707. doi: 10.1007/s11571-024-10115-y. Epub 2024 May 3.
Currently, electroencephalogram (EEG)-based motor imagery (MI) signals have been received extensive attention, which can assist disabled subjects to control wheelchair, automatic driving and other activities. However, EEG signals are easily affected by some factors, such as muscle movements, wireless devices, power line, etc., resulting in the low signal-to-noise ratios and the worse recognition results on EEG decoding. Therefore, it is crucial to develop a stable model for decoding MI-EEG signals. To address this issue and further improve the decoding performance for MI tasks, a hybrid structure combining convolutional neural networks and bidirectional long short-term memory (BLSTM) model, namely CBLSTM, is developed in this study to handle the various EEG-based MI tasks. Besides, the attention mechanism (AM) model is further adopted to adaptively assign the weight of EEG vital features and enhance the expression which beneficial to classification for MI tasks. First of all, the spatial features and the time series features are extracted by CBLSTM from preprocessed MI-EEG data, respectively. Meanwhile, more effective features information can be mined by the AM model, and the softmax function is utilized to recognize intention categories. Ultimately, the numerical results illustrate that the model presented achieves an average accuracy of 98.40% on the public physioNet dataset and faster training process for decoding MI tasks, which is superior to some other advanced models. Ablation experiment performed also verifies the effectiveness and feasibility of the developed model. Moreover, the established network model provides a good basis for the application of brain-computer interface in rehabilitation medicine.
目前,基于脑电图(EEG)的运动想象(MI)信号受到了广泛关注,它可以帮助残疾受试者控制轮椅、自动驾驶等活动。然而,EEG信号很容易受到一些因素的影响,如肌肉运动、无线设备、电源线等,导致信噪比低,EEG解码的识别结果较差。因此,开发一个稳定的MI-EEG信号解码模型至关重要。为了解决这个问题并进一步提高MI任务的解码性能,本研究开发了一种结合卷积神经网络和双向长短期记忆(BLSTM)模型的混合结构,即CBLSTM,以处理各种基于EEG的MI任务。此外,进一步采用注意力机制(AM)模型来自适应地分配EEG重要特征的权重,并增强有利于MI任务分类的表达。首先,CBLSTM分别从预处理的MI-EEG数据中提取空间特征和时间序列特征。同时,AM模型可以挖掘更有效的特征信息,并利用softmax函数识别意图类别。最终,数值结果表明,所提出的模型在公共physioNet数据集上实现了98.40%的平均准确率,并且在MI任务解码方面具有更快的训练过程,优于其他一些先进模型。进行的消融实验也验证了所开发模型的有效性和可行性。此外,所建立的网络模型为脑机接口在康复医学中的应用提供了良好的基础。