Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA.
Public Health Modeling Unit, Yale School of Public Health, New Haven, CT, USA.
Med Decis Making. 2024 Oct;44(7):770-786. doi: 10.1177/0272989X241262343. Epub 2024 Jul 26.
Methods to present the result of cost-effectiveness analyses under parameter uncertainty include cost-effectiveness planes (CEPs), cost-effectiveness acceptability curves/frontier (CEACs/CEAF), expected loss curves (ELCs), and net monetary benefit (NMB) lines. We describe how NMB lines can be augmented to present NMB values that could be achieved by reducing or resolving parameter uncertainty. We evaluated the ability of these methods to correctly 1) identify the alternative with the highest expected NMB and 2) communicate the magnitude of parameter and decision uncertainty.
We considered 4 hypothetical decision problems representing scenarios with high variance or correlated cost and effect estimates and alternatives with similar cost-effectiveness ratios. We used these decision problems to demonstrate the limitations of existing methods and the potential of augmented NMB lines to resolve these issues.
CEPs and CEACs/CEAF could falsely imply the lack of sufficient evidence to identify the optimal option if cost and effect estimates have high variance, are correlated across alternatives, or when alternatives have similar cost-effectiveness ratios. The augmented NMB lines and ELCs can correctly identify the option with the highest expected NMB and communicate the potential benefit of resolving uncertainties. Like ELCs, the augmented NMB lines provide information about the value of resolving parameter uncertainties, but augmented NMB lines may be easier to interpret for decision makers.
Our analysis supports recommending the augment NMB lines as an important method to present the results of economic evaluation studies under parameter uncertainty.
The results of cost-effectiveness analyses (CEAs) when the cost and effect estimates of alternatives are uncertain are commonly presented using cost-effectiveness planes (CEPs), cost-effectiveness acceptability curves/frontier (CEACs/CEAF), and expected loss curves (ELCs).Although currently not often used, net monetary benefit (NMB) lines could present the results of cost-effectiveness to identify the alternative with the highest expected NMB values given the current level of uncertainty. Furthermore, NMB lines can be augmented to 1) show metrics of value of information, which measure the value of additional research to reduce or eliminate the decision uncertainty, and 2) display the confidence intervals along the NMB lines to ensure that NMB values are estimated accurately using a sufficiently large number of parameter samples.Using several decision problems, we demonstrate the limitation of existing methods to present the results of CEAs under parameter uncertainty and how augmented NMB lines could resolve these issues.Our analysis supports recommending augmented NMB lines as an important method to present the results of CEA under uncertainty since they 1) correctly identify the alternative with the highest expected NMB value given the current evidence, 2) provide information about the potential value of additional research to improve the decision by reducing or resolving uncertainty in model parameters, 3) assist the analysis to visually ensure that enough parameter samples are used to estimate the expected NMB of alternatives, and 4) are easier to interpret for decision makers compared with other methods.
在参数不确定性下呈现成本效益分析结果的方法包括成本效益平面(CEPs)、成本效益可接受性曲线/前沿(CEACs/CEAF)、预期损失曲线(ELCs)和净货币收益(NMB)线。我们描述了如何扩充 NMB 线以呈现通过降低或解决参数不确定性可以实现的 NMB 值。我们评估了这些方法正确识别具有最高预期 NMB 的替代方案的能力,以及传达参数和决策不确定性程度的能力。
我们考虑了 4 个假设决策问题,这些问题代表了具有高方差或相关成本和效果估计值的情况,以及具有相似成本效益比的替代方案。我们使用这些决策问题来展示现有方法的局限性,以及扩充 NMB 线解决这些问题的潜力。
如果成本和效果估计值具有高方差、在替代方案之间相互关联或替代方案具有相似的成本效益比,则 CEPs 和 CEACs/CEAF 可能会错误地暗示缺乏足够的证据来确定最佳选择。扩充的 NMB 线和 ELCs 可以正确识别具有最高预期 NMB 的选项,并传达解决不确定性的潜在收益。与 ELCs 一样,扩充的 NMB 线提供了有关解决参数不确定性的价值的信息,但扩充的 NMB 线可能更易于决策者解释。
我们的分析支持推荐扩充 NMB 线作为在参数不确定性下呈现经济评估研究结果的重要方法。
当替代方案的成本和效果估计值不确定时,成本效益分析(CEA)的结果通常使用成本效益平面(CEPs)、成本效益可接受性曲线/前沿(CEACs/CEAF)和预期损失曲线(ELCs)呈现。尽管目前不常使用,但净货币收益(NMB)线可以在当前不确定性水平下,通过展示给定当前不确定性水平下具有最高预期 NMB 值的替代方案的结果,呈现成本效益分析的结果。此外,NMB 线可以扩充为 1)显示信息价值指标,这些指标衡量减少或消除决策不确定性所需的额外研究的价值,以及 2)显示 NMB 线上的置信区间,以确保使用足够数量的参数样本准确估计 NMB 值。
我们使用几个决策问题,展示了现有方法在参数不确定性下呈现 CEA 结果的局限性,以及扩充 NMB 线如何解决这些问题。
我们的分析支持推荐扩充 NMB 线作为在不确定性下呈现 CEA 结果的重要方法,因为它们 1)正确识别了具有当前证据的最高预期 NMB 值的替代方案,2)提供了有关通过降低或解决模型参数不确定性来提高决策的潜在价值的信息,3)通过视觉辅助分析,确保使用足够数量的参数样本来估计替代方案的预期 NMB,4)与其他方法相比,更易于决策者解释。