School of Information Engineering, Wuhan University of Technology, Wuhan 430070, People's Republic of China.
School of Computer Science and Information Engineering, Hubei University, Wuhan 430062, People's Republic of China.
J Neural Eng. 2022 Sep 7;19(5). doi: 10.1088/1741-2552/ac84a9.
. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device independence, the motor imagery (MI) electroencephalography (EEG) signal is used as a common BCI signal source to achieve direct control of external devices. Several online MI EEG-based systems have shown potential for rehabilitation. However, the generalization ability of the current classification model of MI tasks is still limited and the real-time prototype is far from widespread in practice.. To solve these problems, this paper proposes an optimized neural network architecture based on our previous work. Firstly, the artifact components in the MI-EEG signal are removed by using the threshold and threshold function related to the artifact removal evaluation index, and then the data is augmented by the empirical mode decomposition (EMD) algorithm. Furthermore, the ensemble learning (EL) method and fine-tuning strategy in transfer learning (TL) are used to optimize the classification model. Finally, combined with the flexible binary encoding strategy, the EEG signal recognition results are mapped to the control commands of the robotic arm, which realizes multiple degrees of freedom control of the robotic arm.. The results show that EMD has an obvious data amount enhancement effect on a small dataset, and the EL and TL can improve intra-subject and inter-subject model evaluation performance, respectively. The use of a binary coding method realizes the expansion of control instructions, i.e. four kinds of MI-EEG signals are used to complete the control of 7 degrees of freedom of the robotic arm.. Our work not only improves the classification accuracy of the subject and the generality of the classification model while also extending the BCI control instruction set.
脑机接口 (BCI) 技术是一种创新的信息交换方式,可以将生理信号有效地转换为机器的控制指令。由于其自发性和设备独立性,运动想象 (MI) 脑电图 (EEG) 信号被用作常见的 BCI 信号源,以实现对外设的直接控制。几个在线 MI EEG 基 BCI 系统已经显示出康复的潜力。然而,当前 MI 任务分类模型的泛化能力仍然有限,实时原型在实践中还远远没有普及。为了解决这些问题,本文提出了一种基于我们之前工作的优化神经网络架构。首先,使用与去伪影评估指标相关的阈值和阈值函数去除 MI-EEG 信号中的伪影成分,然后使用经验模态分解 (EMD) 算法对数据进行扩充。此外,使用集成学习 (EL) 方法和迁移学习 (TL) 中的微调策略优化分类模型。最后,结合灵活的二进制编码策略,将 EEG 信号识别结果映射到机械臂的控制命令,实现机械臂的多自由度控制。结果表明,EMD 对小数据集具有明显的数据增强效果,EL 和 TL 分别可以提高内个体和外个体模型的评估性能。使用二进制编码方法实现了控制指令的扩展,即四种 MI-EEG 信号用于完成机械臂 7 个自由度的控制。我们的工作不仅提高了分类精度和分类模型的通用性,同时还扩展了 BCI 控制指令集。