Lim Wee-Shin, Fan Sung-Pin, Chiu Shu-I, Wu Meng-Ciao, Wang Pu-He, Lin Kun-Pei, Chen Yung-Ming, Peng Pei-Ling, Jang Jyh-Shing Roger, Lin Chin-Hsien
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan.
Department of Neurology, National Taiwan University Hospital, Taipei, Taiwan.
NPJ Parkinsons Dis. 2025 May 5;11(1):111. doi: 10.1038/s41531-025-00953-w.
Smart devices can easily capture changes in voice, movements, and gait in people with Parkinson's disease (PD). We investigated whether smartphone-derived multimodal features combined with machine learning algorithms can aid in early PD identification. We recruited 496 participants, split into a training cohort (127 PD patients during "on" phase and 198 age-matched controls) and a test dataset (86 patients during "off" phase and 85 age-matched controls). Multidomain features from smartphone recordings were analyzed using machine learning classifiers with integration of a hyperparameter grid. Single-modality models for voice, hand movements, and gait showed diagnostic values of 0.88, 0.74, and 0.81, respectively, with test dataset values of 0.80, 0.74, and 0.76. An integrated multimodal model using a support vector machine improved performance to 0.86 and achieved 0.82 for identifying early-stage PD during the "off" phase. A smartphone-based integrated multimodality model combining voice, hand movement, and gait shows promise for early PD identification.
智能设备能够轻松捕捉帕金森病(PD)患者的语音、动作和步态变化。我们研究了源自智能手机的多模态特征与机器学习算法相结合是否有助于早期帕金森病的识别。我们招募了496名参与者,分为一个训练队列(127名处于“开”期的帕金森病患者和198名年龄匹配的对照者)和一个测试数据集(86名处于“关”期的患者和85名年龄匹配的对照者)。使用集成超参数网格的机器学习分类器对智能手机记录的多领域特征进行了分析。语音、手部动作和步态的单模态模型诊断值分别为0.88、0.74和0.81,测试数据集的值分别为0.80、0.74和0.76。使用支持向量机的集成多模态模型将性能提高到了0.86,在“关”期识别早期帕金森病时达到了0.82。基于智能手机的结合语音、手部动作和步态的集成多模态模型在早期帕金森病识别方面显示出了前景。