Department of Rheumatology and Immunology, Singapore General Hospital, Singapore, Singapore.
Duke-National University of Singapore, Singapore, Singapore.
Int J Rheum Dis. 2019 Jun;22(6):1036-1040. doi: 10.1111/1756-185X.13523. Epub 2019 Mar 6.
The modified Rodnan skin score (mRSS) is a validated outcome measure for skin thickness in systemic sclerosis (SSc). Training has been shown to reduce variability in the measurement of mRSS. Our objective was to assess the inter- and intra-observer variability of mRSS scoring using the proposed recommendations for training by the Scleroderma Clinical Trials Consortium (SCTC) and World Scleroderma Foundation (WSF).
Fifty-two trainees and eight adult SSc patients participated in the SSc skin scoring workshop that was conducted in two sessions by four teachers. Each session, attended by 26 trainees, had a teaching and evaluation phase. The teaching phase comprised of: (a) lecture on mRSS scoring; (b) video demonstration of mRSS scoring; and (c) live demonstration of mRSS on one SSc patient. In the evaluation phase, each trainee independently assessed the mRSS in four SSc patients. For intra-observer reliability, 14 trainees re-assessed the mRSS of two SSc patients whom they had previously examined. We computed the inter- and intra-observer variability using a linear mixed model.
For the evaluation phase, 34 (65.4%) trainees were within five units of the established teachers' score in 3 out of 4 patients. Overall, the whole group had acceptable inter-observer variability (intra-class correlation coefficient [ICC] = 0.71, mean = 8.64 and within-patient standard deviation [SD] = 4.25). The intra-observer ICC was 0.85 and within-patient SD was 2.73.
There was good inter-observer and excellent intra-observer reliability. This is the first study examining the training of assessors using the SCTC/WSF recommendations and our results support the importance of standardized training for skin scoring.
改良的罗德南皮肤评分(mRSS)是系统性硬化症(SSc)皮肤厚度的一种经过验证的结局测量指标。培训已被证明可降低 mRSS 测量的变异性。我们的目的是评估使用 Scleroderma Clinical Trials Consortium(SCTC)和 World Scleroderma Foundation(WSF)提出的培训建议对 mRSS 评分的观察者间和观察者内变异性。
52 名学员和 8 名成年 SSc 患者参加了由 4 位教师分两期进行的 SSc 皮肤评分研讨会。每期有 26 名学员参加,包括教学和评估两个阶段。教学阶段包括:(a)mRSS 评分讲座;(b)mRSS 评分视频演示;和(c)对一名 SSc 患者进行 mRSS 现场演示。在评估阶段,每位学员独立评估了 4 名 SSc 患者的 mRSS。为了评估观察者内的可靠性,14 名学员重新评估了他们之前检查过的两名 SSc 患者的 mRSS。我们使用线性混合模型计算了观察者间和观察者内的变异性。
在评估阶段,34 名(65.4%)学员在 4 名患者中的 3 名中,与既定教师评分相差 5 分以内。总体而言,整个组的观察者间变异性可接受(组内相关系数[ICC]为 0.71,平均值为 8.64,患者内标准差[SD]为 4.25)。观察者内 ICC 为 0.85,患者内 SD 为 2.73。
存在良好的观察者间和极好的观察者内可靠性。这是第一项使用 SCTC/WSF 建议评估评估者培训的研究,我们的结果支持皮肤评分标准化培训的重要性。