Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, Sichuan, China.
Department of Radiology, Sanya People's Hospital, Sanya, Hainan, China.
Eur Radiol. 2023 May;33(5):3467-3477. doi: 10.1007/s00330-023-09414-5. Epub 2023 Feb 7.
To comprehensively evaluate the reporting quality, risk of bias, and radiomics methodology quality of radiomics models for predicting microvascular invasion in hepatocellular carcinoma.
A systematic search of available literature was performed in PubMed, Embase, Web of Science, Scopus, and the Cochrane Library up to January 21, 2022. Studies that developed and/or validated machine learning models based on radiomics data to predict microvascular invasion in hepatocellular carcinoma were included. These studies were reviewed by two investigators and the consensus data were used for analyzing. The reporting quality, risk of bias, and radiomics methodological quality were evaluated by Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD), Prediction model Risk of Bias Assessment Tool, and Radiomics Quality Score (RQS), respectively.
A total of 30 studies met eligibility criteria with 24 model developing studies and 6 model developing and external validation studies. The median overall TRIPOD adherence was 75.4% (range 56.7-94.3%). All studies were at high risk of bias with at least 2 of 20 sources of bias. Furthermore, 28 studies showed unclear risks of bias in up to 5 signaling questions because of the lack of specified reports. The median RQS score was 37.5% (range 25-61.1%).
Current radiomic models for MVI-status prediction have moderate to good reporting quality, moderate radiomics methodology quality, and high risk of bias in model development and validation.
• Current microvascular invasion prediction radiomics studies have moderate to good reporting quality, moderate radiomics methodology quality, and high risk of bias in model development and validation. • Data representativeness, feature robustness, events-per-variable ratio, evaluation metrics, and appropriate validation are five main aspects futures studies should focus more on to improve the quality of radiomics. • Both Radiomics Quality Score and Prediction model Risk of Bias Assessment Tool are needed to comprehensively evaluate a radiomics study.
全面评估用于预测肝细胞癌微血管侵犯的影像组学模型的报告质量、偏倚风险和影像组学方法学质量。
系统检索了截至 2022 年 1 月 21 日 PubMed、Embase、Web of Science、Scopus 和 Cochrane Library 中可用的文献。纳入了基于影像组学数据开发和/或验证用于预测肝细胞癌微血管侵犯的机器学习模型的研究。由两名研究人员对这些研究进行了审查,并使用共识数据进行分析。通过 Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD)、Prediction model Risk of Bias Assessment Tool 和 Radiomics Quality Score (RQS) 分别评估报告质量、偏倚风险和影像组学方法学质量。
共有 30 项研究符合入选标准,其中 24 项为模型开发研究,6 项为模型开发和外部验证研究。总体而言,TRIPOD 依从性中位数为 75.4%(范围为 56.7%-94.3%)。所有研究均存在至少 20 个偏倚源中的 2 个,具有较高的偏倚风险。此外,由于缺乏具体报告,28 项研究在多达 5 个信号问题中存在不明确的偏倚风险。RQS 评分中位数为 37.5%(范围为 25%-61.1%)。
目前用于 MVI 状态预测的放射组学模型具有中等至较好的报告质量、中等的放射组学方法学质量以及在模型开发和验证中存在较高的偏倚风险。