Zhang Jie, Zhao Yihui, Shone Fergus, Li Zhenhong, Frangi Alejandro F, Xie Sheng Quan, Zhang Zhi-Qiang
IEEE Trans Neural Syst Rehabil Eng. 2023;31:484-493. doi: 10.1109/TNSRE.2022.3226860. Epub 2023 Feb 1.
Musculoskeletal models have been widely used for detailed biomechanical analysis to characterise various functional impairments given their ability to estimate movement variables (i.e., muscle forces and joint moments) which cannot be readily measured in vivo. Physics-based computational neuromusculoskeletal models can interpret the dynamic interaction between neural drive to muscles, muscle dynamics, body and joint kinematics and kinetics. Still, such set of solutions suffers from slowness, especially for the complex models, hindering the utility in real-time applications. In recent years, data-driven methods have emerged as a promising alternative due to the benefits in speedy and simple implementation, but they cannot reflect the underlying neuromechanical processes. This paper proposes a physics-informed deep learning framework for musculoskeletal modelling, where physics-based domain knowledge is brought into the data-driven model as soft constraints to penalise/regularise the data-driven model. We use the synchronous muscle forces and joint kinematics prediction from surface electromyogram (sEMG) as the exemplar to illustrate the proposed framework. Convolutional neural network (CNN) is employed as the deep neural network to implement the proposed framework. Simultaneously, the physics law between muscle forces and joint kinematics is used the soft constraint. Experimental validations on two groups of data, including one benchmark dataset and one self-collected dataset from six healthy subjects, are performed. The experimental results demonstrate the effectiveness and robustness of the proposed framework.
肌肉骨骼模型因其能够估计体内难以直接测量的运动变量(即肌肉力量和关节力矩),已被广泛用于详细的生物力学分析,以表征各种功能障碍。基于物理的计算神经肌肉骨骼模型可以解释神经对肌肉的驱动、肌肉动力学、身体和关节运动学及动力学之间的动态相互作用。然而,这样一组解决方案存在速度慢的问题,特别是对于复杂模型,这阻碍了其在实时应用中的效用。近年来,数据驱动方法由于其在快速简单实现方面的优势而成为一种有前途的替代方法,但它们无法反映潜在的神经力学过程。本文提出了一种用于肌肉骨骼建模的物理知识深度学习框架,其中基于物理的领域知识作为软约束引入数据驱动模型,以惩罚/规范数据驱动模型。我们使用从表面肌电图(sEMG)预测同步肌肉力量和关节运动学作为示例来说明所提出的框架。卷积神经网络(CNN)被用作深度神经网络来实现所提出的框架。同时,肌肉力量和关节运动学之间的物理定律被用作软约束。对两组数据进行了实验验证,包括一个基准数据集和一个来自六名健康受试者的自收集数据集。实验结果证明了所提出框架的有效性和鲁棒性。