Rahman Wasifur, Hasan Masum, Islam Md Saiful, Olubajo Titilayo, Thaker Jeet, Abdelkader Abdelrahman, Yang Phillip, Paulson Henry, Oz Gulin, Durr Alexandra, Klockgether Thomas, Ashizawa Tetsuo, Hoque Ehsan
University of Rochester, USA.
Houston Methodist, USA.
Proc ACM Interact Mob Wearable Ubiquitous Technol. 2023 Mar;7(1). doi: 10.1145/3580845. Epub 2023 Mar 28.
Many patients with neurological disorders, such as Ataxia, do not have easy access to neurologists, -especially those living in remote localities and developing/underdeveloped countries. Ataxia is a degenerative disease of the nervous system that surfaces as difficulty with motor control, such as walking imbalance. Previous studies have attempted automatic diagnosis of Ataxia with the help of wearable biomarkers, Kinect, and other sensors. These sensors, while accurate, do not scale efficiently well to naturalistic deployment settings. In this study, we propose a method for identifying ataxic symptoms by analyzing videos of participants walking down a hallway, captured with a standard monocular camera. In a collaboration with 11 medical sites located in 8 different states across the United States, we collected a dataset of 155 videos along with their severity rating from 89 participants (24 controls and 65 diagnosed with or are pre-manifest spinocerebellar ataxias). The participants performed the gait task of the Scale for the Assessment and Rating of Ataxia (SARA). We develop a computer vision pipeline to detect, track, and separate the participants from their surroundings and construct several features from their body pose coordinates to capture gait characteristics such as step width, step length, swing, stability, speed, etc. Our system is able to identify and track a patient in complex scenarios. For example, if there are multiple people present in the video or an interruption from a passerby. Our Ataxia risk-prediction model achieves 83.06% accuracy and an 80.23% F1 score. Similarly, our Ataxia severity-assessment model achieves a mean absolute error (MAE) score of 0.6225 and a Pearson's correlation coefficient score of 0.7268. Our model competitively performed when evaluated on data from medical sites not used during training. Through feature importance analysis, we found that our models associate wider steps, decreased walking speed, and increased instability with greater Ataxia severity, which is consistent with previously established clinical knowledge. Furthermore, we are releasing the models and the body-pose coordinate dataset to the research community - the largest dataset on ataxic gait (to our knowledge). Our models could contribute to improving health access by enabling remote Ataxia assessment in non-clinical settings without requiring any sensors or special cameras. Our dataset will help the computer science community to analyze different characteristics of Ataxia and to develop better algorithms for diagnosing other movement disorders.
许多患有神经系统疾病(如共济失调)的患者难以接触到神经科医生,尤其是那些生活在偏远地区以及发展中国家/欠发达国家的患者。共济失调是一种神经系统退行性疾病,表现为运动控制困难,如行走不平衡。此前的研究曾尝试借助可穿戴生物标志物、Kinect及其他传感器对共济失调进行自动诊断。这些传感器虽然准确,但在自然场景部署中扩展性不佳。在本研究中,我们提出了一种通过分析参与者在走廊行走的视频来识别共济失调症状的方法,这些视频由标准单目摄像头拍摄。我们与美国8个不同州的11个医疗站点合作,收集了155个视频组成的数据集,以及来自89名参与者(24名对照者和65名被诊断患有或处于脊髓小脑共济失调前期的患者)的严重程度评级。参与者完成了共济失调评估与评分量表(SARA)的步态任务。我们开发了一个计算机视觉流程,用于检测、跟踪参与者并将其与周围环境分离,并从他们的身体姿态坐标构建多个特征,以捕捉步态特征,如步宽、步长、摆动、稳定性、速度等。我们的系统能够在复杂场景中识别和跟踪患者。例如,如果视频中有多人出现或有路人干扰。我们的共济失调风险预测模型准确率达到83.06%,F1分数为80.23%。同样,我们的共济失调严重程度评估模型平均绝对误差(MAE)分数为0.6225,皮尔逊相关系数分数为0.7268。在对未用于训练的医疗站点的数据进行评估时,我们的模型表现具有竞争力。通过特征重要性分析,我们发现我们的模型将更宽的步幅、降低的行走速度和增加的不稳定性与更高的共济失调严重程度联系起来,这与先前确立的临床知识一致。此外,我们正在向研究界发布这些模型和身体姿态坐标数据集——据我们所知,这是关于共济失调步态的最大数据集。我们的模型可以通过在非临床环境中实现远程共济失调评估,而无需任何传感器或特殊摄像头,从而有助于改善医疗服务的可及性。我们的数据集将帮助计算机科学界分析共济失调的不同特征,并开发更好的算法来诊断其他运动障碍。