Annu Int Conf IEEE Eng Med Biol Soc. 2021 Nov;2021:4859-4862. doi: 10.1109/EMBC46164.2021.9629749.
Motion capture systems are extensively used to track human movement to study healthy and pathological movements, allowing for objective diagnosis and effective therapy of conditions that affect our motor system. Current motion capture systems typically require marker placements which is cumbersome and can lead to contrived movements.Here, we describe and evaluate our developed markerless and modular multi-camera motion capture system to record human movements in 3D. The system consists of several interconnected single-board microcomputers, each coupled to a camera (i.e., the camera modules), and one additional microcomputer, which acts as the controller. The system allows for integration with upcoming machine-learning techniques, such as DeepLabCut and AniPose. These tools convert the video frames into virtual marker trajectories and provide input for further biomechanical analysis.The system obtains a frame rate of 40 Hz with a sub-millisecond synchronization between the camera modules. We evaluated the system by recording index finger movement using six camera modules. The recordings were converted via trajectories of the bony segments into finger joint angles. The retrieved finger joint angles were compared to a marker-based system resulting in a root-mean-square error of 7.5 degrees difference for a full range metacarpophalangeal joint motion.Our system allows for out-of-the-lab motion capture studies while eliminating the need for reflective markers. The setup is modular by design, enabling various configurations for both coarse and fine movement studies, allowing for machine learning integration to automatically label the data. Although we compared our system for a small movement, this method can also be extended to full-body experiments in larger volumes.
运动捕捉系统被广泛用于跟踪人体运动,以研究健康和病理运动,从而实现对影响运动系统的疾病的客观诊断和有效治疗。目前的运动捕捉系统通常需要标记物的放置,这很繁琐,并且可能导致人为的运动。在这里,我们描述并评估了我们开发的无标记和模块化多摄像机运动捕捉系统,以记录人体的 3D 运动。该系统由几个相互连接的单板微型计算机组成,每个微型计算机与一个摄像头(即摄像头模块)相连,还有一个额外的微型计算机作为控制器。该系统允许与即将推出的机器学习技术(如 DeepLabCut 和 AniPose)集成。这些工具将视频帧转换为虚拟标记轨迹,并为进一步的生物力学分析提供输入。该系统的帧率为 40Hz,相机模块之间的同步时间为亚毫秒级。我们通过使用六个摄像头模块记录食指运动来评估该系统。通过轨迹将骨骼段记录转化为指关节角度。将获取的指关节角度与基于标记的系统进行比较,结果表明,在整个掌指关节运动范围内,差异的均方根误差为 7.5 度。我们的系统允许在实验室外进行运动捕捉研究,同时无需使用反光标记物。该系统的设计是模块化的,允许进行各种粗调和精细运动研究的配置,从而实现机器学习集成,自动标记数据。虽然我们将该系统用于小运动进行了比较,但这种方法也可以扩展到更大体积的全身实验中。