Wyatt Steven, Mohammed Mohammed A, Spilsbury Peter
The Strategy Unit - NHS Midlands and Lancashire Commissioning Support Unit, Birmingham, UK.
Faculty of Health Studies, University of Bradford, Bradford, UK.
Cost Eff Resour Alloc. 2024 Dec 4;22(1):90. doi: 10.1186/s12962-024-00594-5.
Risk prediction tools are widely used in healthcare to identify individuals at high risk of adverse events who may benefit from proactive interventions. Traditionally, these tools are evaluated primarily on statistical performance measures-such as sensitivity, specificity, discrimination, and positive predictive value (PPV)-with minimal attention given to their cost-effectiveness. As a result, while many published tools report high performance statistics, evidence is limited on their real-world efficacy and potential for cost savings. To address this gap, we propose a straightforward framework for evaluating risk prediction tools during the design phase, which incorporates both PPV and intervention effectiveness, measured by the number needed to treat (NNT). This framework shows that to be cost-effective, the per-unit cost of an intervention (I) must be less than the average cost of the adverse event (A) multiplied by the PPV-to-NNT ratio: I < A*PPV/NNT. This criterion enables decision-makers to assess the economic value of a risk prediction tool before implementation.
风险预测工具在医疗保健领域被广泛用于识别可能从积极干预中受益的、有不良事件高风险的个体。传统上,这些工具主要根据统计性能指标(如敏感性、特异性、鉴别力和阳性预测值(PPV))进行评估,而对其成本效益关注甚少。因此,虽然许多已发表的工具报告了高性能统计数据,但关于它们在现实世界中的疗效和成本节约潜力的证据有限。为了弥补这一差距,我们提出了一个在设计阶段评估风险预测工具的简单框架,该框架将PPV和干预效果(通过治疗所需人数(NNT)衡量)都纳入其中。该框架表明,要具有成本效益,干预措施的单位成本(I)必须小于不良事件的平均成本(A)乘以PPV与NNT的比值:I < A * PPV / NNT。这一标准使决策者能够在实施前评估风险预测工具的经济价值。