Department of Health Services Research, CAPHRI-Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands.
AHEAD GmbH-Agency for Health Economic Assessment and Dissemination, Waschhausgasse 17, 79540, Lörrach, Germany.
Pharmacoeconomics. 2021 Apr;39(4):433-446. doi: 10.1007/s40273-021-01008-7. Epub 2021 Mar 10.
This research aims to (1) replicate published health economic models, (2) compare reproduced results with original results, (3) identify facilitators and hurdles to model replicability and determine reproduction success, and (4) suggest model replication reporting standards to enhance model reproducibility, in the context of health economic obesity models.
Four health economic obesity models simulating an adult UK population were identified, selected for replication, and evaluated using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist. Reproduction results were compared to original results, focusing on cost-effectiveness outcomes, and the resulting reproduction success was assessed by published criteria. Replication facilitators and hurdles were identified and transferred into related reporting standards.
All four case studies were state-transition models simulating costs and quality-adjusted life-years (QALYs). Comparing original versus reproduction outcomes, the following deviation ranges were observed: costs - 3.9 to 16.1% (mean over all model simulations 3.78%), QALYs - 3.7 to 2.1% (mean - 0.11%), and average cost-utility ratios - 3.0 to 17.9% (mean 4.28%). Applying different published criteria, an overall reproduction success was observed for three of four models. Key replication facilitators were input data tables and model diagrams, while missing standard deviations and missing formulas for equations were considered as key hurdles.
This study confirms the feasibility of rebuilding health economic obesity models, but minor to major assumptions were needed to fill reporting gaps. Model replications can help to assess the quality of health economic model documentation and can be used to validate current model reporting practices. Simple changes to actual CHEERS reporting criteria may solve identified replication hurdles.
本研究旨在：(1) 复制已发表的健康经济模型，(2) 将复制结果与原始结果进行比较，(3) 确定模型可复制性的促进因素和障碍，并确定复制成功的标准，以及(4) 提出模型复制报告标准，以提高健康经济肥胖模型的可复制性。
确定并选择了 4 个模拟英国成年人的健康经济肥胖模型进行复制，并使用健康经济评估报告标准一致性（CHEERS）清单进行评估。通过发表的标准评估复制成功的程度，重点关注成本效益结果，并比较原始结果和复制结果。确定复制的促进因素和障碍，并将其转化为相关的报告标准。
所有四个案例研究都是模拟成本和质量调整生命年（QALYs）的状态转移模型。比较原始结果和复制结果，观察到以下偏差范围：成本 - 3.9% 至 16.1%（所有模型模拟的平均值为 3.78%），QALYs - 3.7% 至 2.1%（平均值为-0.11%），以及平均成本效益比 - 3.0% 至 17.9%（平均值为 4.28%）。根据不同的发表标准，四个模型中有三个模型的整体复制成功率很高。关键的复制促进因素是输入数据表和模型图，而缺失标准偏差和方程的公式被认为是关键障碍。
本研究证实了重建健康经济肥胖模型的可行性，但需要对假设进行细微到重大的调整以填补报告中的空白。模型复制可以帮助评估健康经济模型文档的质量，并可用于验证当前的模型报告实践。对实际 CHEERS 报告标准进行简单的修改可能会解决已确定的复制障碍。
