Medicine, University of Alberta, Edmonton, Alberta, Canada
CARE ARTHRITIS Limited, Edmonton, Alberta, Canada.
RMD Open. 2024 Feb 13;10(1):e003923. doi: 10.1136/rmdopen-2023-003923.
The Spondyloarthritis Research Consortium of Canada (SPARCC) developers have created web-based calibration modules for the SPARCC MRI sacroiliac joint (SIJ) scoring methods. We aimed to test the impact of applying these e-modules on the feasibility and reliability of these methods.
The SPARCC-SIJ e-modules contain cases with baseline and follow-up scans and an online scoring interface. Visual real-time feedback regarding concordance/discordance of scoring with expert readers is provided by a colour-coding scheme. Reliability is assessed in real time by intraclass correlation coefficient (ICC), cases being scored until ICC targets are attained. Participating readers (n=17) from the EuroSpA Imaging project were randomised to one of two reader calibration strategies that each comprised three stages. Baseline and follow-up scans from 25 cases were scored after each stage was completed. Reliability was compared with a SPARCC developer, and the System Usability Scale (SUS) assessed feasibility.
The reliability of readers for scoring bone marrow oedema was high after the first stage of calibration, and only minor improvement was noted following the use of the inflammation module. Greater enhancement of reader reliability was evident after the use of the structural module and was most consistently evident for the scoring of erosion (ICC status/change: stage 1 (0.42/0.20) to stage 3 (0.50/0.38)) and backfill (ICC status/change: stage 1 (0.51/0.19) to stage 3 (0.69/0.41)). The feasibility of both e-modules was evident by high SUS scores.
The SPARCC-SIJ e-modules are feasible, effective knowledge transfer tools, and their use is recommended before using the SPARCC methods for clinical research and tria.
加拿大脊柱关节炎研究联合会(SPARCC)开发者创建了基于网络的 SPARCC MRI 骶髂关节(SIJ)评分方法校准模块。我们旨在测试应用这些电子模块对这些方法的可行性和可靠性的影响。
SPARCC-SIJ 电子模块包含基线和随访扫描病例,以及在线评分界面。通过颜色编码方案提供有关与专家读者评分一致性/不一致性的实时视觉反馈。通过组内相关系数(ICC)实时评估可靠性,评分直至达到 ICC 目标。来自 EuroSpA Imaging 项目的参与读者(n=17)随机分为两种读者校准策略之一,每种策略均包含三个阶段。在完成每个阶段后,对 25 例基线和随访扫描进行评分。与 SPARCC 开发者进行可靠性比较,并使用系统可用性量表(SUS)评估可行性。
在第一阶段校准后,读者对骨髓水肿评分的可靠性很高,在使用炎症模块后仅略有提高。使用结构模块后,读者的可靠性得到了更大的提高,并且在评分侵蚀(ICC 状态/变化:第 1 阶段(0.42/0.20)至第 3 阶段(0.50/0.38))和填充(ICC 状态/变化:第 1 阶段(0.51/0.19)至第 3 阶段(0.69/0.41))方面最为明显。两个电子模块的可行性都通过高 SUS 得分得到证明。
SPARCC-SIJ 电子模块是可行的、有效的知识转移工具,建议在将 SPARCC 方法用于临床研究和试验之前使用。