TIMC-Techniques de l'Ingénierie Médicale et de la Complexité- Université Joseph Fourier-Grenoble 1, Grenoble, France.
Dev Med Child Neurol. 2012 Sep;54(9):815-21. doi: 10.1111/j.1469-8749.2012.04359.x. Epub 2012 Jul 19.
To evaluate the interrater reliability of the inclusion in registries and classification of children with cerebral palsy (CP).
Two studies were conducted. In study 1, 12 paediatricians from 11 countries viewed video sequences of 12 children with or without CP (nine males, three females; median age 6y; range 2-16). In study 2, 19 professionals from eight countries participated in an online exercise. They had to classify the same children but based on written vignettes. All participants had to evaluate whether the child had CP, the neurological subtype (Surveillance of Cerebral Palsy in Europe classification system), and gross motor function level (Gross Motor Function Classification System [GMFCS]). Kappa (κ) coefficients were calculated for categorical variables and intraclass correlation coefficients (ICCs) for ordinal data.
Reliability was excellent in assessing whether or not a child had CP in study 1 (κ=1.00) and substantial in study 2 (κ=0.73); 95% confidence interval [CI] 0.58-0.87). For the neurological subtype, overall κ between paediatricians was 0.85 (95% CI 0.68-0.98), with full agreement observed for eight children. In study 2, overall κ was 0.78 (95% CI 0.61-0.91) with full agreement seen for five children. For the GMFCS, the ICC was 0.88 (95% CI 0.78-0.95) in study 1 and 0.80 (95% CI 0.64-0.91) in study 2.
Reliability was excellent for all characteristics classified by paediatricians viewing the videos and substantial for professionals reading vignettes.
评估将脑性瘫痪(CP)患儿纳入登记处和分类的纳入标准的观察者间可靠性。
进行了两项研究。在研究 1 中,来自 11 个国家的 12 名儿科医生观看了 12 名患有或不患有 CP(9 名男性,3 名女性;中位数年龄 6 岁;范围 2-16 岁)的儿童的视频序列。在研究 2 中,来自 8 个国家的 19 名专业人员参加了在线练习。他们必须根据书面病例报告对相同的儿童进行分类。所有参与者必须评估儿童是否患有 CP、神经学亚型(欧洲脑瘫监测分类系统)和粗大运动功能分级(粗大运动功能分级系统[GMFCS])。对于分类变量,计算 Kappa(κ)系数;对于有序数据,计算组内相关系数(ICC)。
在研究 1 中,评估儿童是否患有 CP 的可靠性为极好(κ=1.00),在研究 2 中为中等(κ=0.73);95%置信区间[CI]0.58-0.87)。对于神经学亚型,儿科医生之间的总体κ值为 0.85(95%CI 0.68-0.98),有 8 名儿童完全一致。在研究 2 中,总体κ值为 0.78(95%CI 0.61-0.91),有 5 名儿童完全一致。对于 GMFCS,研究 1 的 ICC 为 0.88(95%CI 0.78-0.95),研究 2 的 ICC 为 0.80(95%CI 0.64-0.91)。
观看视频的儿科医生对所有特征的分类可靠性极好,阅读病例报告的专业人员的分类可靠性为中等。