Institute of Medical Informatics, University of Münster, 48149 Münster, Germany.
Institute of Geophysics, University of Münster, 48149 Münster, Germany.
Sensors (Basel). 2021 Apr 30;21(9):3139. doi: 10.3390/s21093139.
Smartwatches provide technology-based assessments in Parkinson's Disease (PD). It is necessary to evaluate their reliability and accuracy in order to include those devices in an assessment. We present unique results for sensor validation and disease classification via machine learning (ML). A comparison setup was designed with two different series of Apple smartwatches, one Nanometrics seismometer and a high-precision shaker to measure tremor-like amplitudes and frequencies. Clinical smartwatch measurements were acquired from a prospective study including 450 participants with PD, differential diagnoses (DD) and healthy participants. All participants wore two smartwatches throughout a 15-min examination. Symptoms and medical history were captured on the paired smartphone. The amplitude error of both smartwatches reaches up to 0.005 g, and for the measured frequencies, up to 0.01 Hz. A broad range of different ML classifiers were cross-validated. The most advanced task of distinguishing PD vs. DD was evaluated with 74.1% balanced accuracy, 86.5% precision and 90.5% recall by Multilayer Perceptrons. Deep-learning architectures significantly underperformed in all classification tasks. Smartwatches are capable of capturing subtle tremor signs with low noise. Amplitude and frequency differences between smartwatches and the seismometer were under the level of clinical significance. This study provided the largest PD sample size of two-hand smartwatch measurements and our preliminary ML-evaluation shows that such a system provides powerful means for diagnosis classification and new digital biomarkers, but it remains challenging for distinguishing similar disorders.
智能手表为帕金森病(PD)提供了基于技术的评估。为了将这些设备纳入评估,有必要评估其可靠性和准确性。我们通过机器学习(ML)为传感器验证和疾病分类提供了独特的结果。设计了一个比较设置,其中包括两个不同系列的苹果智能手表、一个 Nanometrics 地震计和一个高精度振动器,用于测量类似震颤的幅度和频率。通过一项包括 450 名 PD 患者、鉴别诊断(DD)和健康参与者的前瞻性研究获得了临床智能手表测量值。所有参与者在 15 分钟的检查过程中佩戴了两个智能手表。症状和病史通过配对的智能手机捕获。两个智能手表的幅度误差高达 0.005g,测量频率的误差高达 0.01Hz。交叉验证了广泛的不同 ML 分类器。使用多层感知机评估了区分 PD 与 DD 的最先进任务,平衡准确率为 74.1%,精度为 86.5%,召回率为 90.5%。深度学习架构在所有分类任务中的表现都明显较差。智能手表能够捕捉到低噪声的细微震颤迹象。智能手表和地震计之间的幅度和频率差异低于临床意义水平。这项研究提供了最大的双手智能手表测量 PD 样本量,我们的初步 ML 评估表明,这样的系统为诊断分类和新的数字生物标志物提供了强大的手段,但对于区分类似疾病仍然具有挑战性。