Department of Physical Therapy and Human Movement Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
J Neuromuscul Dis. 2018;5(4):509-521. doi: 10.3233/JND-180327.
The NeuroNEXT SMA Infant Biomarker Study, a two year, longitudinal, multi-center study of infants with SMA type 1 and healthy infants, presented a unique opportunity to assess multi-site rater reliability on three infant motor function tests (MFTs) commonly used to assess infants with SMA type 1.
To determine the effect of prospective MFT rater training and the effect of rater experience on inter-rater and intra-rater reliability for the Test of Infant Motor Performance Screening Items (TIMPSI), the Children's Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP-INTEND) and the Alberta Infant Motor Scale (AIMS).
Training was conducted utilizing a novel set of motor function test (MFT) videos to optimize accurate MFT administration and reliability for the study duration. Inter- and intra-rater reliability of scoring for the TIMPSI and inter-rater reliability of scoring for the CHOP INTEND and the AIMS was assessed using intraclass correlation coefficients (ICC). Effect of rater experience on reliability was examined using ICC. Agreement with 'expert' consensus scores was examined using Pearson's correlation coefficients.
Inter-rater reliability on all MFTs was good to excellent. Intra-rater reliability for the primary MFT, the TIMPSI, was excellent for the study duration. Agreement with 'expert' consensus was within predetermined limits (≥85%) after training. Evaluator experience with SMA and MFTs did not affect reliability.
Reliability of scores across evaluators was demonstrated for all three study MFTs and scores were reproducible on repeated administration. Evaluator experience had no effect on reliability.
NeuroNEXT SMA 婴儿生物标志物研究是一项为期两年的纵向多中心研究，研究对象为 1 型 SMA 患儿和健康婴儿，为评估三种常用于评估 1 型 SMA 患儿的婴儿运动功能测试（MFT）的多站点评估者间可靠性提供了独特的机会。
确定前瞻性 MFT 评估者培训的效果以及评估者经验对 Test of Infant Motor Performance Screening Items（TIMPSI）、费城儿童医院婴儿神经肌肉疾病测试（CHOP-INTEND）和 Alberta 婴儿运动量表（AIMS）的评估者间和评估者内可靠性的影响。
使用一套新的运动功能测试（MFT）视频进行培训，以优化研究期间的 MFT 准确管理和可靠性。使用组内相关系数（ICC）评估 TIMPSI 的评估者间和评估者内评分以及 CHOP INTEND 和 AIMS 的评估者间评分的可靠性。使用 ICC 检查评估者经验对可靠性的影响。使用 Pearson 相关系数评估与“专家”共识评分的一致性。
所有 MFT 的评估者间可靠性均为良好至优秀。TIMPSI 作为主要 MFT，在整个研究期间的评估者内可靠性均为优秀。培训后，与“专家”共识的一致性在预定范围内（≥85%）。评估者对 SMA 和 MFT 的经验并不影响可靠性。
所有三种研究 MFT 的评估者间评分可靠性均得到证明，且在重复评估时评分具有可重复性。评估者经验对可靠性没有影响。
