Department of Computer Science, University of Verona, Italy.
Neuromotor and Cognitive Rehabilitation Research Center (CRRNC) - Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy.
Comput Methods Programs Biomed. 2022 Oct;225:107016. doi: 10.1016/j.cmpb.2022.107016. Epub 2022 Jul 14.
Human pose estimation (HPE) through deep learning-based software applications is a trend topic for markerless motion analysis. Thanks to the accuracy of the state-of-the-art technology, HPE could enable gait analysis in the telemedicine practice. On the other hand, delivering such a service at a distance requires the system to satisfy multiple and different constraints like accuracy, portability, real-time, and privacy compliance at the same time. Existing solutions either guarantee accuracy and real-time (e.g., the widespread OpenPose software on well-equipped computing platforms) or portability and data privacy (e.g., light convolutional neural networks on mobile phones). We propose a portable and low-cost platform that implements real-time and accurate 3D HPE through an embedded software on a low-power off-the-shelf computing device that guarantees privacy by default and by design. We present an extended evaluation of both accuracy and performance of the proposed solution conducted with a marker-based motion capture system (i.e., Vicon) as ground truth. The results show that the platform achieves real-time performance and high-accuracy with a deviation below the error tolerance when compared to the marker-based motion capture system (e.g., less than an error of 5 on the estimated knee flexion difference on the entire gait cycle and correlation 0.91<ρ<0.99). We provide a proof-of-concept study, showing that such portable technology, considering the limited discrepancies with respect to the marker-based motion capture system and its working tolerance, could be used for gait analysis at a distance without leading to different clinical interpretation.
基于深度学习的软件应用的人体姿势估计 (HPE) 是无标记运动分析的热门话题。由于最先进技术的准确性,HPE 可以使远程医疗实践中的步态分析成为可能。另一方面,提供这样的服务需要系统同时满足多种不同的约束条件,如准确性、便携性、实时性和隐私合规性。现有的解决方案要么保证准确性和实时性(例如,功能齐全的计算平台上广泛使用的 OpenPose 软件),要么保证便携性和数据隐私性(例如,手机上的轻量级卷积神经网络)。我们提出了一种便携式和低成本的平台,该平台通过在低功耗现成计算设备上的嵌入式软件实现实时和准确的 3D HPE,默认和通过设计来保证隐私。我们提出了对基于标记的运动捕捉系统(即 Vicon)作为地面实况的准确性和性能的扩展评估。结果表明,与基于标记的运动捕捉系统相比,该平台实现了实时性能和高精度,偏差低于误差容限(例如,在整个步态周期中估计的膝关节弯曲差异小于 5 的误差,相关系数 0.91<ρ<0.99)。我们提供了一个概念验证研究,表明考虑到与基于标记的运动捕捉系统及其工作容限的有限差异,这种便携式技术可用于远程步态分析,而不会导致不同的临床解释。