Khalid Syed I, Roy Joanna M, Massaad Elie, Thomson Kyle, Mirpuri Pranav, Patel Aashka, Mehta Ankit I, Kiapour Ali, Shin John H
Department of Neurosurgery, University of Illinois at Chicago, Chicago, IL, USA.
Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
Global Spine J. 2025 May 31:21925682251335880. doi: 10.1177/21925682251335880.
Study DesignLiterature review.ObjectiveThe Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) statement was developed to improve the generalizability of predictive models. This study systematically evaluated the quality of predictive models related to spine procedures and assessed their compliance with the TRIPOD guidelines.MethodsA systematic search was conducted on PubMed to identify original research articles published between January 1st, 2018, and February 1st, 2023 reporting prediction models in the top six spine journals ranked by Scimago Journal Ranking (SJR): Journal of Bone and Joint Surgery, Spine, Journal of Orthopaedic Trauma, Journal of Neurosurgery: Spine, Neurosurgery, and Neurosurgical Focus. We assessed article adherence to the TRIPOD criteria using a standardized checklist.Results72 articles were included and analyzed with the TRIPOD checklist. Median compliance with the TRIPOD criteria was 57.14% (IQR: 48.33-64.95%). Compliance varied significantly across journals ( < 0.05). Among the TRIPOD criteria, the lowest compliance was observed in blinding the assessment of predictors (n = 8, 16.00%), fully presenting the model for use (n = 12, 17.91%), and providing sufficient information to allow for the external validation of results (n = 13, 19.70%).ConclusionsPublished machine learning models predicting outcomes in spine surgery often do not meet the established guidelines for their development, validation, and reporting outlined by TRIPOD. This lack of compliance may suggest that these models have not been adequately validated externally or adopted into routine clinical practice in spine surgery.
研究设计
文献综述。
目的
制定个体预后或诊断多变量预测模型的透明报告(TRIPOD)声明,以提高预测模型的可推广性。本研究系统评估了与脊柱手术相关的预测模型的质量,并评估其对TRIPOD指南的遵守情况。
方法
在PubMed上进行系统检索,以识别2018年1月1日至2023年2月1日期间发表在Scimago期刊排名(SJR)排名前六位的脊柱期刊上的报告预测模型的原创研究文章:《骨与关节外科杂志》《脊柱》《骨科创伤杂志》《神经外科杂志:脊柱》《神经外科》和《神经外科聚焦》。我们使用标准化清单评估文章对TRIPOD标准的遵守情况。
结果
纳入72篇文章并使用TRIPOD清单进行分析。对TRIPOD标准的中位遵守率为57.14%(四分位间距:48.33 - 64.95%)。各期刊之间的遵守情况差异显著(<0.05)。在TRIPOD标准中,预测因素评估的盲法(n = 8,16.00%)、完整呈现模型以供使用(n = 12,17.91%)以及提供足够信息以允许对结果进行外部验证(n = 13,19.70%)方面的遵守率最低。
结论
已发表的预测脊柱手术结果的机器学习模型通常不符合TRIPOD概述的其开发、验证和报告的既定指南。这种缺乏遵守可能表明这些模型尚未在外部得到充分验证,或未被纳入脊柱手术的常规临床实践。