Department of Biomedical Informatics, Columbia University, New York, New York, USA
Department of Biomedical Informatics, Columbia University, New York, New York, USA.
BMJ Open. 2021 Aug 3;11(8):e044964. doi: 10.1136/bmjopen-2020-044964.
The number of readmission risk prediction models available has increased rapidly, and these models are used extensively for health decision-making. Unfortunately, readmission models can be subject to flaws in their development and validation, as well as limitations in their clinical usefulness.
To critically appraise readmission models in the published literature using Delphi-based recommendations for their development and validation.
We used the modified Delphi process to create (CAMPR), which lists expert recommendations focused on development and validation of readmission models. Guided by CAMPR, two researchers independently appraised published readmission models in two recent systematic reviews and concurrently extracted data to generate reference lists of eligibility criteria and risk factors.
We found that published models (n=81) followed 6.8 recommendations (45%) on average. Many models had weaknesses in their development, including failure to internally validate (12%), failure to account for readmission at other institutions (93%), failure to account for missing data (68%), failure to discuss data preprocessing (67%) and failure to state the model's eligibility criteria (33%).
The high prevalence of weaknesses in model development identified in the published literature is concerning, as these weaknesses are known to compromise predictive validity. CAMPR may support researchers, clinicians and administrators to identify and prevent future weaknesses in model development.
可用的再入院风险预测模型数量迅速增加,这些模型广泛用于医疗决策。不幸的是,再入院模型在开发和验证方面可能存在缺陷,并且在临床应用方面存在局限性。
使用基于德尔菲法的发展和验证建议,对已发表文献中的再入院模型进行批判性评估。
我们使用改良德尔菲法制定了再入院模型开发和验证的专家建议清单(CAMPR)。根据 CAMPR,两名研究人员独立评估了最近两项系统评价中发表的再入院模型,并同时提取数据,生成资格标准和风险因素的参考列表。
我们发现发表的模型(n=81)平均遵循了 6.8 条建议(45%)。许多模型在开发方面存在弱点,包括内部验证失败(12%)、未考虑其他机构的再入院情况(93%)、未考虑缺失数据(68%)、未讨论数据预处理(67%)以及未说明模型的资格标准(33%)。
发表文献中再入院模型开发方面的弱点普遍存在令人担忧,因为这些弱点已知会影响预测准确性。CAMPR 可能有助于研究人员、临床医生和管理人员识别和预防未来模型开发中的弱点。