Bullock Garrett S, Mylott Joseph, Hughes Tom, Nicholson Kristen F, Riley Richard D, Collins Gary S
Department of Orthopaedic Surgery, Wake Forest School of Medicine, 475 Vine St, Bowman Gray Medical Building, Winston-Salem, NC, 27101, USA.
Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, University of Oxford, Oxford, UK.
Sports Med. 2022 Oct;52(10):2469-2482. doi: 10.1007/s40279-022-01698-9. Epub 2022 Jun 11.
An increasing number of musculoskeletal injury prediction models are being developed and implemented in sports medicine. Prediction model quality needs to be evaluated so clinicians can be informed of their potential usefulness.
To evaluate the methodological conduct and completeness of reporting of musculoskeletal injury prediction models in sport.
A systematic review was performed from inception to June 2021. Studies were included if they: (1) predicted sport injury; (2) used regression, machine learning, or deep learning models; (3) were written in English; (4) were peer reviewed.
Thirty studies (204 models) were included; 60% of studies utilized only regression methods, 13% only machine learning, and 27% both regression and machine learning approaches. All studies developed a prediction model and no studies externally validated a prediction model. Two percent of models (7% of studies) were low risk of bias and 98% of models (93% of studies) were high or unclear risk of bias. Three studies (10%) performed an a priori sample size calculation; 14 (47%) performed internal validation. Nineteen studies (63%) reported discrimination and two (7%) reported calibration. Four studies (13%) reported model equations for statistical predictions and no machine learning studies reported code or hyperparameters.
Existing sport musculoskeletal injury prediction models were poorly developed and have a high risk of bias. No models could be recommended for use in practice. The majority of models were developed with small sample sizes, had inadequate assessment of model performance, and were poorly reported. To create clinically useful sports musculoskeletal injury prediction models, considerable improvements in methodology and reporting are urgently required.
在运动医学领域,越来越多的肌肉骨骼损伤预测模型正在被开发和应用。需要对预测模型的质量进行评估,以便临床医生了解其潜在的实用性。
评估运动中肌肉骨骼损伤预测模型的方法学实施情况和报告的完整性。
从开始到2021年6月进行了一项系统综述。纳入的研究需满足以下条件:(1)预测运动损伤;(2)使用回归、机器学习或深度学习模型;(3)用英文撰写;(4)经过同行评审。
纳入了30项研究(204个模型);60%的研究仅使用回归方法,13%仅使用机器学习,27%同时使用回归和机器学习方法。所有研究都开发了一个预测模型,没有研究对预测模型进行外部验证。2%的模型(7%的研究)存在低偏倚风险,98%的模型(93%的研究)存在高或不清楚的偏倚风险。三项研究(10%)进行了先验样本量计算;14项(47%)进行了内部验证。19项研究(63%)报告了辨别力,两项(7%)报告了校准情况。四项研究(13%)报告了用于统计预测的模型方程,没有机器学习研究报告代码或超参数。
现有的运动肌肉骨骼损伤预测模型开发不完善,存在高偏倚风险。没有模型可推荐用于实践。大多数模型是基于小样本量开发的,对模型性能的评估不足,报告也很差。为了创建临床上有用的运动肌肉骨骼损伤预测模型,迫切需要在方法学和报告方面有相当大的改进。