基于深度学习的外骨骼步态分析的深度感知姿态估计。
Depth-aware pose estimation using deep learning for exoskeleton gait analysis.
机构信息
School of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China.
出版信息
Sci Rep. 2023 Dec 19;13(1):22681. doi: 10.1038/s41598-023-50207-z.
In rehabilitation medicine, real-time analysis of the gait for human wearing lower-limb exoskeleton rehabilitation robot during walking can effectively prevent patients from experiencing excessive and asymmetric gait during rehabilitation training, thereby avoiding falls or even secondary injuries. To address the above situation, we propose a gait detection method based on computer vision for the real-time monitoring of gait during human-machine integrated walking. Specifically, we design a neural network model called GaitPoseNet, which is used for posture recognition in human-machine integrated walking. Using RGB images as input and depth features as output, regression of joint coordinates through depth estimation of implicit supervised networks. In addition, joint guidance strategy (JGS) is designed in the network framework. The degree of correlation between the various joints of the human body is used as a detection target to effectively overcome prediction difficulties due to partial joint occlusion during walking. Finally, a post processing algorithm is designed to describe patients' walking motion by combining the pixel coordinates of each joint point and leg length. Our advantage is that we provide a non-contact measurement method with strong universality, and use depth estimation and JGS to improve measurement accuracy. Conducting experiments on the Walking Pose with Exoskeleton (WPE) Dataset shows that our method can reach 95.77% PCKs@0.1, 93.14% PCKs@0.08 and 3.55 ms runtime. Therefore our method achieves advanced performance considering both speed and accuracy.
在康复医学中,实时分析穿戴下肢外骨骼康复机器人的人体步态,可有效防止患者在康复训练中出现步态过大和不对称的情况,从而避免跌倒甚至二次受伤。针对上述情况,我们提出了一种基于计算机视觉的人机融合行走步态检测方法,用于实时监测人机融合行走中的步态。具体来说,我们设计了一种名为 GaitPoseNet 的神经网络模型,用于人机融合行走中的姿态识别。该模型以 RGB 图像作为输入,深度特征作为输出,通过隐式监督网络的深度估计回归关节坐标。此外,我们在网络框架中设计了关节引导策略(JGS)。利用人体各关节之间的相关性作为检测目标,有效克服了行走过程中部分关节遮挡导致的预测困难。最后,我们设计了一种后处理算法,通过结合每个关节点和腿长的像素坐标来描述患者的行走运动。我们的优势在于提供了一种具有强通用性的非接触式测量方法,利用深度估计和 JGS 提高了测量精度。在人机外骨骼行走数据集(WPE)上进行的实验表明,我们的方法在速度和精度方面都取得了先进的性能,达到了 95.77% PCKs@0.1、93.14% PCKs@0.08 和 3.55ms 的运行时间。