Wang Gang, Jin Long, Zhang Jiliang, Duan Xiaoqin, Yi Jiang, Zhang Mingming, Sun Zhongbo
IEEE Trans Neural Syst Rehabil Eng. 2024;32:3577-3589. doi: 10.1109/TNSRE.2024.3459924. Epub 2024 Sep 27.
Decoding continuous human motion from surface electromyography (sEMG) in advance is crucial for improving the intelligence of exoskeleton robots. However, incomplete sEMG signals are prevalent on account of unstable data transmission, sensor malfunction, and electrode sheet detachment. These non-ideal factors severely compromise the accuracy of continuous motion recognition and the reliability of clinical applications. To tackle this challenge, this paper develops a multi-task parallel learning framework for continuous motion estimation with incomplete sEMG signals. Concretely, a residual network is incorporated into a recurrent neural network to integrate the information flow of hidden states and reconstruct random and consecutive missing sEMG signals. The attention mechanism is applied for redistributing the distribution of weights. A jointly optimized loss function is devised to enable training the model for simultaneously dealing with signal anomalies/absences and multi-joint continuous motion estimation. The proposed model is implemented for estimating hip, knee, and ankle joint angles of physically competent individuals and patients during diverse exercises. Experimental results indicate that the estimation root-mean-square errors with 60% missing sEMG signals steadily converges to below 5 degrees. Even with multi-channel electrode sheet shedding, our model still demonstrates cutting-edge estimation performance, errors only marginally increase 1 degree.
提前从表面肌电图(sEMG)中解码连续的人体运动对于提高外骨骼机器人的智能至关重要。然而,由于数据传输不稳定、传感器故障和电极片脱落,不完整的sEMG信号很普遍。这些不理想因素严重影响了连续运动识别的准确性和临床应用的可靠性。为应对这一挑战,本文针对不完整sEMG信号的连续运动估计开发了一种多任务并行学习框架。具体而言,将残差网络融入循环神经网络,以整合隐藏状态的信息流并重建随机和连续缺失的sEMG信号。应用注意力机制来重新分配权重分布。设计了一个联合优化的损失函数,以使模型能够同时处理信号异常/缺失和多关节连续运动估计。所提出的模型用于估计身体健全的个体和患者在各种运动过程中的髋、膝和踝关节角度。实验结果表明,对于缺失60%的sEMG信号,估计均方根误差稳定收敛到5度以下。即使在多通道电极片脱落的情况下,我们的模型仍表现出前沿的估计性能,误差仅略微增加1度。