De Laet Tinne, Papageorgiou Eirini, Nieuwenhuys Angela, Desloovere Kaat
Faculty of Engineering Science, KU Leuven, Belgium.
Department of Rehabilitation Sciences, Faculty of Kinesiology and Rehabilitation Sciences (FaBeR), KU Leuven, Belgium.
PLoS One. 2017 Jun 1;12(6):e0178378. doi: 10.1371/journal.pone.0178378. eCollection 2017.
This study aimed to improve the automatic probabilistic classification of joint motion gait patterns in children with cerebral palsy by using the expert knowledge available via a recently developed Delphi-consensus study. To this end, this study applied both Naïve Bayes and Logistic Regression classification with varying degrees of usage of the expert knowledge (expert-defined and discretized features). A database of 356 patients and 1719 gait trials was used to validate the classification performance of eleven joint motions.
Two main hypotheses stated that: (1) Joint motion patterns in children with CP, obtained through a Delphi-consensus study, can be automatically classified following a probabilistic approach, with an accuracy similar to clinical expert classification, and (2) The inclusion of clinical expert knowledge in the selection of relevant gait features and the discretization of continuous features increases the performance of automatic probabilistic joint motion classification.
This study provided objective evidence supporting the first hypothesis. Automatic probabilistic gait classification using the expert knowledge available from the Delphi-consensus study resulted in accuracy (91%) similar to that obtained with two expert raters (90%), and higher accuracy than that obtained with non-expert raters (78%). Regarding the second hypothesis, this study demonstrated that the use of more advanced machine learning techniques such as automatic feature selection and discretization instead of expert-defined and discretized features can result in slightly higher joint motion classification performance. However, the increase in performance is limited and does not outweigh the additional computational cost and the higher risk of loss of clinical interpretability, which threatens the clinical acceptance and applicability.
本研究旨在通过利用最近开展的德尔菲共识研究中获得的专家知识,改进脑瘫患儿关节运动步态模式的自动概率分类。为此,本研究应用了朴素贝叶斯和逻辑回归分类方法,并采用了不同程度的专家知识(专家定义和离散化特征)。使用一个包含356名患者和1719次步态试验的数据库来验证11种关节运动的分类性能。
两个主要假设指出:(1)通过德尔菲共识研究获得的脑瘫患儿关节运动模式可以采用概率方法进行自动分类,其准确性与临床专家分类相似;(2)在选择相关步态特征和对连续特征进行离散化时纳入临床专家知识,可提高自动概率关节运动分类的性能。
本研究提供了支持第一个假设的客观证据。使用德尔菲共识研究中获得的专家知识进行自动概率步态分类,其准确率(91%)与两名专家评分者的准确率(90%)相似,且高于非专家评分者的准确率(78%)。关于第二个假设,本研究表明,使用更先进的机器学习技术,如自动特征选择和离散化,而不是专家定义和离散化的特征,可能会导致关节运动分类性能略有提高。然而,性能的提升是有限的,且不超过额外的计算成本以及临床可解释性丧失的更高风险,这对临床接受度和适用性构成威胁。