Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Changning District, Shanghai, 200050, China.
Department of Radiology, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, No. 600 Yishan Road, Xuhui District, Shanghai, 200233, China.
Eur Radiol. 2021 Mar;31(3):1526-1535. doi: 10.1007/s00330-020-07221-w. Epub 2020 Sep 2.
To assess the methodological quality and risk of bias in radiomics studies investigating diagnosis, therapy response, and survival of patients with osteosarcoma.
In this systematic review, literatures on radiomics in osteosarcoma were included and assessed for methodological quality through the radiomics quality score (RQS). The risk of bias and concern of application was assessed using the Quality Assessment of Diagnostic Accuracy Studies tool. A meta-analysis of studies focusing on predicting osteosarcoma response to neoadjuvant chemotherapy was performed.
Twelve radiomics studies exploring osteosarcoma were identified, and five were included in meta-analysis. The RQS reached an average of 20.4% (6.92 of 36) with good inter-rater agreement (ICC 0.95, 95% CI 0.85-0.99). Four studies validated results with an internal dataset, none of which used external dataset; one study was prospectively designed, and another one shared part of the dataset. The risk of bias and concern of application were mainly related to index test aspect. The meta-analysis showed a diagnostic odds ratio of 43.68 (95%CI 13.5-141.31) for predicting response to neoadjuvant chemotherapy with high heterogeneity and low methodological quality.
The overall scientific quality of included studies is insufficient; however, radiomics remains a promising technology for predicting treatment response, which might guide therapeutic decision-making and related to prognosis. Improvements in study design, validation, and open science needs to be made to demonstrate the generalizability of findings and to achieve clinical applications. Widespread application of RQS, pre-trained RQS scoring procedure, and modification of RQS in response to clinical needs are necessary.
• Limited radiomics studies were established in osteosarcoma with mean RQS of 20.4%, commonly due to unvalidated results, retrospective study design, and absence of open science. • Meta-analysis of radiomics studies predicting osteosarcoma response to neoadjuvant chemotherapy showed high diagnostic odds ratio 43.68, while high heterogeneity and low methodological quality were the main concerns. • A previously trained data extraction instrument allowed reaching moderate inter-rater agreement in RQS applications, while RQS still needs improvement to become a wide adaptive tool in reviews of radiomics studies, in routine self-check before manuscript submitting and in study design.
评估骨肿瘤放射组学研究在诊断、治疗反应和生存预测方面的方法学质量和偏倚风险。
在本系统评价中,纳入了骨肿瘤放射组学研究的文献,并通过放射组学质量评分(RQS)评估其方法学质量。使用诊断准确性研究质量评估工具评估偏倚风险和应用关注。对聚焦于预测骨肉瘤对新辅助化疗反应的研究进行了 meta 分析。
共确定了 12 项探索骨肿瘤的放射组学研究,其中 5 项纳入了 meta 分析。RQS 平均达到 20.4%(36 分中的 6.92 分),具有良好的组内一致性(ICC 0.95,95%CI 0.85-0.99)。四项研究使用内部数据集进行了结果验证,均未使用外部数据集;一项研究为前瞻性设计,另一项研究共享了部分数据集。偏倚风险和应用关注主要与指标检测方面有关。meta 分析显示,预测新辅助化疗反应的诊断比值比为 43.68(95%CI 13.5-141.31),但存在高度异质性和低方法学质量。
纳入研究的整体科学质量不足;然而,放射组学仍然是一种有前途的预测治疗反应的技术,可能有助于指导治疗决策,并与预后相关。需要改进研究设计、验证和开放科学,以证明研究结果的普遍性,并实现临床应用。广泛应用 RQS、预训练的 RQS 评分程序以及根据临床需求修改 RQS 是必要的。
• 骨肿瘤放射组学研究数量有限,平均 RQS 为 20.4%,主要原因是结果未经验证、研究设计为回顾性以及缺乏开放科学。• 对预测骨肉瘤对新辅助化疗反应的放射组学研究进行的 meta 分析显示,诊断比值比较高(43.68),但高度异质性和低方法学质量是主要关注点。• 应用之前经过训练的文献数据提取工具可实现 RQS 应用的中等组内一致性,而 RQS 仍需要改进,以成为放射组学研究综述、投稿前常规自我检查和研究设计中的广泛适用工具。