IEEE Trans Neural Syst Rehabil Eng. 2021;29:1624-1633. doi: 10.1109/TNSRE.2021.3104761. Epub 2021 Aug 26.
Estimations of human joint torques can provide clinically valuable information to inform patient care, plan therapy, and assess the design of wearable robotic devices. Predicting joint torques into the future can also be useful for anticipatory robot control design. In this work, we present a method of mapping joint torque estimates and sequences of torque predictions from motion capture and ground reaction forces to wearable sensor data using several modern types of neural networks. We use dense feedforward, convolutional, neural ordinary differential equation, and long short-term memory neural networks to learn the mapping for ankle plantarflexion and dorsiflexion torque during standing, walking, running, and sprinting, and consider both single-point torque estimation, as well as the prediction of a sequence of future torques. Our results show that long short-term memory neural networks, which consider incoming data sequentially, outperform dense feedforward, neural ordinary differential equation networks, and convolutional neural networks. Predictions of future ankle torques up to 0.4 s ahead also showed strong positive correlations with the actual torques. The proposed method relies on learning from a motion capture dataset, but once the model is built, the method uses wearable sensors that enable torque estimation without the motion capture data.
人体关节扭矩的估计可以提供有临床价值的信息,为患者护理提供信息,计划治疗,并评估可穿戴机器人设备的设计。对未来关节扭矩的预测对于预期机器人控制设计也很有用。在这项工作中,我们提出了一种使用几种现代类型的神经网络将关节扭矩估计值和扭矩预测序列从运动捕捉和地面反作用力映射到可穿戴传感器数据的方法。我们使用密集前馈、卷积、神经常微分方程和长短时记忆神经网络来学习站立、行走、跑步和冲刺期间踝关节跖屈和背屈扭矩的映射,并考虑单点扭矩估计以及未来扭矩序列的预测。我们的结果表明,考虑输入数据顺序的长短时记忆神经网络优于密集前馈、神经常微分方程网络和卷积神经网络。对未来踝关节扭矩的预测甚至可以提前 0.4 秒,也与实际扭矩表现出强烈的正相关。所提出的方法依赖于从运动捕捉数据集学习,但一旦建立模型,该方法就会使用可穿戴传感器来进行扭矩估计,而无需运动捕捉数据。