Dong Runlin, Zhang Xiaodong, Li Hanzhe, Lu Zhufeng, Li Cunxin, Zhu Aibin
School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, China.
Shaanxi Key Laboratory of Intelligent Robots, Xi'an Jiaotong University, Xi'an, Shaanxi, China.
Front Bioeng Biotechnol. 2024 Aug 23;12:1448903. doi: 10.3389/fbioe.2024.1448903. eCollection 2024.
Exoskeleton robot control should ideally be based on human voluntary movement intention. The readiness potential (RP) component of the motion-related cortical potential is observed before movement in the electroencephalogram and can be used for intention prediction. However, its single-trial features are weak and highly variable, and existing methods cannot achieve high cross-temporal and cross-subject accuracies in practical online applications. Therefore, this work aimed to combine a deep convolutional neural network (CNN) framework with a transfer learning (TL) strategy to predict the lower limb voluntary movement intention, thereby improving the accuracy while enhancing the model generalization capability; this would also provide sufficient processing time for the response of the exoskeleton robotic system and help realize robot control based on the intention of the human body.
The signal characteristics of the RP for lower limb movement were analyzed, and a parameter TL strategy based on CNN was proposed to predict the intention of voluntary lower limb movements. We recruited 10 subjects for offline and online experiments. Multivariate empirical-mode decomposition was used to remove the artifacts, and the moment of onset of voluntary movement was labeled using lower limb electromyography signals during network training.
The RP features can be observed from multiple data overlays before the onset of voluntary lower limb movements, and these features have long latency periods. The offline experimental results showed that the average movement intention prediction accuracy was 95.23% ± 1.25% for the right leg and 91.21% ± 1.48% for the left leg, which showed good cross-temporal and cross-subject generalization while greatly reducing the training time. Online movement intention prediction can predict results about 483.9 ± 11.9 ms before movement onset with an average accuracy of 82.75%.
The proposed method has a higher prediction accuracy with a lower training time, has good generalization performance for cross-temporal and cross-subject aspects, and is well-prioritized in terms of the temporal responses; these features are expected to lay the foundation for further investigations on exoskeleton robot control.
理想情况下,外骨骼机器人的控制应基于人类的自主运动意图。运动相关皮层电位的准备电位(RP)成分在脑电图中运动前被观察到,可用于意图预测。然而,其单次试验特征较弱且高度可变,现有方法在实际在线应用中无法实现高跨时间和跨受试者准确率。因此,本研究旨在将深度卷积神经网络(CNN)框架与迁移学习(TL)策略相结合,以预测下肢自主运动意图,从而提高准确率并增强模型泛化能力;这也将为外骨骼机器人系统的响应提供足够的处理时间,并有助于实现基于人体意图的机器人控制。
分析了下肢运动RP的信号特征,提出了一种基于CNN的参数TL策略来预测下肢自主运动意图。我们招募了10名受试者进行离线和在线实验。使用多变量经验模态分解去除伪迹,并在网络训练期间使用下肢肌电信号标记自主运动的起始时刻。
在下肢自主运动开始前,可以从多个数据叠加中观察到RP特征,且这些特征具有较长的潜伏期。离线实验结果表明,右腿的平均运动意图预测准确率为95.23%±1.25%,左腿为91.21%±1.48%,显示出良好的跨时间和跨受试者泛化能力,同时大大缩短了训练时间。在线运动意图预测可以在运动开始前约483.9±11.9毫秒预测结果,平均准确率为82.75%。
所提出的方法具有较高的预测准确率和较短的训练时间,在跨时间和跨受试者方面具有良好的泛化性能,并且在时间响应方面具有良好的优先级;这些特性有望为外骨骼机器人控制的进一步研究奠定基础。