Institute of Medical Informatics, University of Lübeck, Lübeck, Germany.
German Research Center for Artificial Intelligence, Lübeck, Germany.
Mov Disord. 2023 Jul;38(7):1327-1335. doi: 10.1002/mds.29439. Epub 2023 May 11.
Video-based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time-consuming and cumbersome, particularly in large-scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection.
The aim of this study was to evaluate the performances of state-of-the-art ML approaches for automatic video-based tic detection in patients with Tourette syndrome.
We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no-tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network).
Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach.
ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
基于视频的抽动检测和评分可用于独立、客观地评估抽动秽语综合征患者的抽动频率和严重程度。在经过培训的评估者中,评估者间的可靠性较好。然而,视频评分既耗时又繁琐,尤其是在大规模研究中。因此,我们开发了两种机器学习(ML)算法来进行自动视频抽动检测。
本研究旨在评估最先进的 ML 方法在基于视频的抽动自动检测中的性能,以用于抽动秽语综合征患者。
我们使用了 35 名抽动秽语综合征患者的 64 个视频。其中 6 名受试者(15 个视频进行评分)的数据被用于超参数优化的验证集。对于区分抽动和非抽动段的二分类任务,我们建立了两种不同的监督学习方法。首先,我们手动基于地标提取特征,将其作为随机森林分类器(Random Forest)的输入。其次,我们使用完全自动化的深度学习方法,即将视频片段的感兴趣区域输入卷积神经网络(深度神经网络)。
随机森林的抽动检测 F1 评分(和准确率)分别为 82.0%(88.4%),深度神经网络方法分别为 79.5%(88.5%)。
基于视频记录的自动抽动检测 ML 算法是可行且可靠的,因此可以成为一种有价值的评估工具,例如用于临床试验中的客观抽动测量。ML 算法也可能有助于抽动的鉴别诊断。