Nilsson Kristoffer, Fridhammar Adam, Ota Riku, Sall Jensen Morten, Willis Michael, Persson Sofie
The Swedish Institute for Health Economics, Lund, Sweden.
Novo Nordisk A/S, Søborg, Denmark.
J Med Econ. 2025 Dec;28(1):944-963. doi: 10.1080/13696998.2025.2517506. Epub 2025 Jun 22.
Economic simulation models, such as the IHE Type 2 Diabetes Cohort Model (IHE-DCM-T2), are used widely to inform resource allocation for Type 2 Diabetes (T2D) treatments. Recently, IHE-DCM-T2 was augmented with Japanese-specific risk equations to align with the Japanese healthcare context. This study extends prior model validation of IHE-DCM-T2 to cover the Japanese risk equations for applications in Japan's clinical setting and healthcare system.
Face validity was assessed through expert review of model assumptions and structure. Model programming was verified by code review and 728 stress tests. Predictive accuracy was tested by comparing model predictions to real-world outcomes from 28 Japanese studies, assessing concordance visually, with regression lines, and with mean absolute percentage error (MAPE), root mean square percentage error (RMSPE), mean squared logarithmic error (MSLE), and mean squared log-accuracy ratio (MSLAR). Subgroup analyses examined dependent and independent endpoints, along with mortality, microvascular, and macrovascular outcomes. Sensitivity analyses assessed robustness to variations in scale and sample size.
IHE-DCM-T2 demonstrated face validity and correct implementation. External validation against 120 endpoints showed good alignment between predicted and observed events, with regression line slope=0.96 and R=0.98. Overall, prediction errors were: MAPE=0.83, RMSPE=1.21, MSLE=0.61, and MSLAR=0.53. Predictions were more accurate for dependent than independent endpoints. Among endpoint categories, macrovascular events had the lowest average errors, whereas mortality endpoints had the highest MAPE and RMSPE, and microvascular endpoints had highest MSLE and MSLAR. Predictive accuracy was consistent across alternative test specifications.
Limitations included gaps in validation data, and the requirement for long-term follow-up that inherently reflects past treatment patterns. Only studies with at least 1,000 patients were included, which may introduce selection bias.
This comprehensive validation of the IHE-DCM-T2, augmented with Japanese-specific risk equations, demonstrated its suitability for health technology assessments and resource allocation decisions for T2D in the Japanese clinical setting and healthcare system.
经济模拟模型,如IHE 2型糖尿病队列模型(IHE-DCM-T2),被广泛用于为2型糖尿病(T2D)治疗的资源分配提供信息。最近,IHE-DCM-T2增加了日本特定的风险方程,以适应日本的医疗环境。本研究扩展了IHE-DCM-T2先前的模型验证,以涵盖日本风险方程,用于日本临床环境和医疗系统中的应用。
通过专家对模型假设和结构的审查来评估表面效度。通过代码审查和728次压力测试来验证模型编程。通过将模型预测与28项日本研究的实际结果进行比较来测试预测准确性,通过直观评估、回归线评估以及平均绝对百分比误差(MAPE)、均方根百分比误差(RMSPE)、均方对数误差(MSLE)和均方对数准确率(MSLAR)来评估一致性。亚组分析检查了相关和独立终点,以及死亡率、微血管和大血管结局。敏感性分析评估了对规模和样本量变化的稳健性。
IHE-DCM-T2表现出表面效度和正确的实施。针对120个终点的外部验证表明,预测事件与观察到的事件之间具有良好的一致性,回归线斜率 = 0.96,R = 0.98。总体而言,预测误差为:MAPE = 0.83,RMSPE = 1.21,MSLE = 0.61,MSLAR = 0.53。相关终点的预测比独立终点更准确。在终点类别中,大血管事件的平均误差最低,而死亡率终点的MAPE和RMSPE最高,微血管终点的MSLE和MSLAR最高。预测准确性在替代测试规范中是一致的。
局限性包括验证数据存在差距,以及需要长期随访,这本质上反映了过去的治疗模式。仅纳入了至少有1000名患者的研究,这可能会引入选择偏倚。
对增加了日本特定风险方程的IHE-DCM-T2进行的全面验证表明,它适用于日本临床环境和医疗系统中T2D的卫生技术评估和资源分配决策。