Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, UK.
Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, UK.
J Biomech. 2022 Nov;144:111338. doi: 10.1016/j.jbiomech.2022.111338. Epub 2022 Oct 2.
This study presented a fully automated deep learning based markerless motion capture workflow and evaluated its performance against marker-based motion capture during overground running, walking and counter movement jumping. Multi-view high speed (200 Hz) image data were collected concurrently with marker-based motion capture (criterion data), permitting a direct comparison between methods. Lower limb kinematic data for 15 participants were computed using 2D pose estimation, our 3D fusion process and OpenSim based inverse kinematics modelling. Results demonstrated high levels of agreement for lower limb joint angles, with mean differences ranging "0.1° - 10.5° for hip (3 DoF) joint rotations, and 0.7° - 3.9° for knee (1 DoF) and ankle (2 DoF) rotations. These differences generally fall within the documented uncertainties of marker-based motion capture, suggesting that our markerless approach could be used for appropriate biomechanics applications. We used an open-source, modular and customisable workflow, allowing for integration with other popular biomechanics tools such as OpenSim. By developing open-source tools, we hope to facilitate the democratisation of markerless motion capture technology and encourage the transparent development of markerless methods. This presents exciting opportunities for biomechanics researchers and practitioners to capture large amounts of high quality, ecologically valid data both in the laboratory and in the wild.
本研究提出了一种完全自动化的基于深度学习的无标记运动捕捉工作流程,并将其在地面跑步、行走和反向跳跃中的表现与基于标记的运动捕捉进行了评估。多视角高速(200Hz)图像数据与基于标记的运动捕捉(基准数据)同时采集,允许两种方法之间进行直接比较。使用二维姿态估计、我们的 3D 融合过程和基于 OpenSim 的运动学逆解算模型,为 15 名参与者计算了下肢运动学数据。结果表明,下肢关节角度具有高度一致性,髋关节(3 个自由度)关节旋转的平均差异范围为“0.1°-10.5°,膝关节(1 个自由度)和踝关节(2 个自由度)旋转的平均差异范围为 0.7°-3.9°。这些差异通常在基于标记的运动捕捉的记录不确定性范围内,这表明我们的无标记方法可用于适当的生物力学应用。我们使用了一个开源、模块化和可定制的工作流程,允许与其他流行的生物力学工具(如 OpenSim)集成。通过开发开源工具,我们希望促进无标记运动捕捉技术的民主化,并鼓励无标记方法的透明开发。这为生物力学研究人员和从业者提供了在实验室和野外环境中获取大量高质量、生态有效的数据的令人兴奋的机会。