Tagliafico Alberto Stefano, Valle Clarissa, Bonaffini Pietro Andrea, Attieh Ali, Bauckneht Matteo, Belgioia Liliana, Bignotti Bianca, Brunetti Nicole, Bonsignore Alessandro, Capaccio Enrico, De Giorgis Sara, Garlaschi Alessandro, Morbelli Silvia, Rossi Federica, Torri Lorenzo, Caprioli Simone, Tosto Simona, Cea Michele, Dominietto Alida
Department of Health Sciences, University of Genoa, 16132 Genoa, Italy.
Ospedale Policlinico San Martino, 16132 Genoa, Italy.
Diagnostics (Basel). 2022 Aug 4;12(8):1894. doi: 10.3390/diagnostics12081894.
To assess the reliability of the myeloma spine and bone damage score (MSBDS) across multiple readers with different levels of expertise and from different institutions. A reliability exercise, including 104 data sets of static images and complete CT examinations of patients affected by multiple myeloma (MM), was performed. A complementary imaging atlas provided detailed examples of the MSBDS scores, including low-risk and high-risk lesions. A total of 15 readers testing the MSBDS were evaluated. ICC estimates and their 95% confidence intervals were calculated based on mean rating (k = 15), absolute agreement, a two-way random-effects model and Cronbach's alpha. : Overall, the ICC correlation coefficient was 0.87 (95% confidence interval: 0.79-0.92), and the Cronbach's alpha was 0.93 (95% confidence interval: 0.94-0.97). Global inter- and intra-observer agreement among the 15 readers with scores below or equal to 6 points and scores above 6 points were 0.81 (95% C.I.: 0.72-0.86) and 0.94 (95% C.I.:0.91-0.98), respectively. We present a consensus-based semiquantitative scoring systems for CT in MM with a complementary CT imaging atlas including detailed examples of relevant scoring techniques. We found substantial agreement among readers with different levels of experience, thereby supporting the role of the MSBDS for possible large-scale applications. • Based on previous work and definitions of the MSBDS, we present real-life reliability data for quantitative bone damage assessment in multiple myeloma (MM) patients on CT. • In this study, reliability for the MSBDS, which was tested on 15 readers with different levels of expertise and from different institutions, was shown to be moderate to excellent. • The complementary CT imaging atlas is expected to enhance unified interpretations of the MSBDS between different professionals dealing with MM patients in their routine clinical practice.
评估骨髓瘤脊柱和骨损伤评分（MSBDS）在不同专业水平、来自不同机构的多位阅片者之间的可靠性。进行了一项可靠性研究，纳入104例多发性骨髓瘤（MM）患者的静态图像数据集和完整CT检查。一本补充性影像图谱提供了MSBDS评分的详细示例，包括低风险和高风险病变。共有15位测试MSBDS的阅片者接受评估。基于平均评分（k = 15）、绝对一致性、双向随机效应模型和克朗巴哈系数计算组内相关系数（ICC）估计值及其95%置信区间。总体而言，ICC相关系数为0.87（95%置信区间：0.79 - 0.92），克朗巴哈系数为0.93（95%置信区间：0.94 - 0.97）。15位阅片者中，评分低于或等于6分以及高于6分的阅片者之间的总体观察者间和观察者内一致性分别为0.81（95%可信区间：0.72 - 0.86）和0.94（95%可信区间：0.91 - 0.98）。我们提出了一种基于共识的MM患者CT半定量评分系统，并配有一本补充性CT影像图谱，其中包括相关评分技术的详细示例。我们发现不同经验水平的阅片者之间存在高度一致性，从而支持MSBDS在可能的大规模应用中的作用。•基于先前的工作和MSBDS的定义，我们给出了MM患者CT定量骨损伤评估的实际可靠性数据。•在本研究中，对15位来自不同机构、专业水平各异的阅片者测试的MSBDS的可靠性显示为中等至优秀。•预计这本补充性CT影像图谱将增强不同专业人员在日常临床实践中对MM患者MSBDS的统一解读。
