Machine Medicine Technologies Ltd., The Leather Market Unit 1.1.4, 11/13 Weston Street, London SE1 3ER, UK.
Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, Queen Square, London WC1N 3BG, UK.
Sensors (Basel). 2021 Aug 12;21(16):5437. doi: 10.3390/s21165437.
Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson's disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessment (item 3.10). We proposed and evaluated a novel approach for estimating severity of gait impairment in Parkinson's disease using a computer vision-based methodology. The system we developed can be used to obtain an estimate for a rating to catch potential errors, or to gain an initial rating in the absence of a trained clinician-for example, during remote home assessments. Videos (n=729) were collected as part of routine MDS-UPDRS gait assessments of Parkinson's patients, and a deep learning library was used to extract body key-point coordinates for each frame. Data were recorded at five clinical sites using commercially available mobile phones or tablets, and had an associated severity rating from a trained clinician. Six features were calculated from time-series signals of the extracted key-points. These features characterized key aspects of the movement including speed (step frequency, estimated using a novel Gamma-Poisson Bayesian model), arm swing, postural control and smoothness (or roughness) of movement. An ordinal random forest classification model (with one class for each of the possible ratings) was trained and evaluated using 10-fold cross validation. Step frequency point estimates from the Bayesian model were highly correlated with manually labelled step frequencies of 606 video clips showing patients walking towards or away from the camera (Pearson's r=0.80, p<0.001). Our classifier achieved a balanced accuracy of 50% (chance = 25%). Estimated UPDRS ratings were within one of the clinicians' ratings in 95% of cases. There was a significant correlation between clinician labels and model estimates (Spearman's ρ=0.52, p<0.001). We show how the interpretability of the feature values could be used by clinicians to support their decision-making and provide insight into the model's objective UPDRS rating estimation. The severity of gait impairment in Parkinson's disease can be estimated using a single patient video, recorded using a consumer mobile device and within standard clinical settings; i.e., videos were recorded in various hospital hallways and offices rather than gait laboratories. This approach can support clinicians during routine assessments by providing an objective rating (or second opinion), and has the potential to be used for remote home assessments, which would allow for more frequent monitoring.
步态是一种核心运动功能,在许多神经疾病中都受到损害,包括帕金森病(PD)。PD 中的治疗变化通常由临床中的步态评估驱动,通常作为运动障碍协会(MDS)统一 PD 评分量表(UPDRS)评估的一部分进行评估(项目 3.10)。我们提出并评估了一种使用基于计算机视觉的方法来估计帕金森病步态障碍严重程度的新方法。我们开发的系统可用于获得评分估计值以捕捉潜在错误,或在没有经过培训的临床医生的情况下获得初始评分-例如,在远程家庭评估期间。视频(n=729)是作为帕金森病患者 MDS-UPDRS 步态评估的一部分收集的,并且使用深度学习库提取每个帧的身体关键点坐标。数据是使用商业上可用的移动电话或平板电脑在五个临床地点记录的,并具有经过培训的临床医生的相关严重程度评分。从提取关键点的时间序列信号中计算了六个特征。这些特征描述了运动的关键方面,包括速度(使用新的伽马泊松贝叶斯模型估计的步频)、手臂摆动、姿势控制和运动的平滑度(或粗糙度)。使用 10 倍交叉验证训练和评估了一个有序随机森林分类模型(每个可能的评分一个类)。贝叶斯模型的步频点估计值与显示患者向相机或远离相机行走的 606 个视频剪辑的手动标记步频高度相关(Pearson r=0.80,p<0.001)。我们的分类器达到了 50%的平衡准确性(机会=25%)。在 95%的情况下,估计的 UPDRS 评分与临床医生的评分相差一位。临床医生标签和模型估计值之间存在显著相关性(Spearman ρ=0.52,p<0.001)。我们展示了临床医生如何使用特征值的可解释性来支持他们的决策,并深入了解模型的客观 UPDRS 评分估计。可以使用单个患者视频,使用消费类移动设备并在标准临床环境中记录来估计帕金森病患者的步态障碍严重程度;即,视频是在各种医院走廊和办公室而不是步态实验室中记录的。这种方法可以通过提供客观评分(或第二意见)来支持临床医生进行常规评估,并有可能用于远程家庭评估,从而可以更频繁地进行监测。