有前途的算法与危险的应用:预测医疗保健利用的风险分层工具的系统评价。

Promising algorithms to perilous applications: a systematic review of risk stratification tools for predicting healthcare utilisation.

机构信息

Department of Anaesthesia, Critical Care and Pain, Kingston Hospital NHS Foundation Trust, London, UK

Imperial College London Institute of Global Health Innovation, London, UK.

出版信息

BMJ Health Care Inform. 2024 Jun 19;31(1):e101065. doi: 10.1136/bmjhci-2024-101065.

Abstract

OBJECTIVES

Risk stratification tools that predict healthcare utilisation are extensively integrated into primary care systems worldwide, forming a key component of anticipatory care pathways, where high-risk individuals are targeted by preventative interventions. Existing work broadly focuses on comparing model performance in retrospective cohorts with little attention paid to efficacy in reducing morbidity when deployed in different global contexts. We review the evidence supporting the use of such tools in real-world settings, from retrospective dataset performance to pathway evaluation.

METHODS

A systematic search was undertaken to identify studies reporting the development, validation and deployment of models that predict healthcare utilisation in unselected primary care cohorts, comparable to their current real-world application.

RESULTS

Among 3897 articles screened, 51 studies were identified evaluating 28 risk prediction models. Half underwent external validation yet only two were validated internationally. No association between validation context and model discrimination was observed. The majority of real-world evaluation studies reported no change, or indeed significant increases, in healthcare utilisation within targeted groups, with only one-third of reports demonstrating some benefit.

DISCUSSION

While model discrimination appears satisfactorily robust to application context there is little evidence to suggest that accurate identification of high-risk individuals can be reliably translated to improvements in service delivery or morbidity.

CONCLUSIONS

The evidence does not support further integration of care pathways with costly population-level interventions based on risk prediction in unselected primary care cohorts. There is an urgent need to independently appraise the safety, efficacy and cost-effectiveness of risk prediction systems that are already widely deployed within primary care.

摘要

目的

预测医疗保健利用的风险分层工具已在全球范围内广泛整合到初级保健系统中,成为预期保健途径的关键组成部分,高危人群是预防干预的目标。现有的工作主要集中在比较回顾性队列中的模型性能,而很少关注在不同的全球背景下部署时减少发病率的效果。我们回顾了在真实环境中使用这些工具的证据,从回顾性数据集性能到途径评估。

方法

进行了系统搜索,以确定报告开发、验证和部署预测未选择的初级保健队列中医疗保健利用的模型的研究,这些模型与当前的实际应用相当。

结果

在筛选出的 3897 篇文章中,确定了 51 项研究评估了 28 种预测医疗保健利用的风险预测模型。其中一半进行了外部验证,但只有两个进行了国际验证。验证环境与模型区分度之间没有关联。大多数真实世界评估研究报告称,目标群体中的医疗保健利用没有变化,或者实际上显著增加,只有三分之一的报告显示出一些益处。

讨论

虽然模型区分度似乎对应用环境具有足够的稳健性,但几乎没有证据表明可以可靠地将高危人群的准确识别转化为服务提供或发病率的改善。

结论

证据不支持在未选择的初级保健队列中基于风险预测进一步整合具有成本效益的人群干预措施的保健途径。迫切需要独立评估已经广泛部署在初级保健中的风险预测系统的安全性、疗效和成本效益。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/81ce/11191805/c731e03fc9b5/bmjhci-2024-101065f01.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索