Department of Epidemiology and Biostatistics, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran.
Osteoporosis Research Center, Endocrinology and Metabolism Clinical Sciences Institute, Tehran University of Medical Sciences, Tehran, Iran.
Int J Health Policy Manag. 2022 Feb 1;11(2):210-217. doi: 10.34172/ijhpm.2020.103.
Considering the importance of cardiovascular disease (CVD) risk prediction for healthcare systems and the limited information available in the Middle East, we evaluated the SCORE and Globorisk models to predict CVD death in a country of this region.
We included 24 427 participants (11 187 men) aged 40-80 years from four population-based cohorts in Iran. Updating approaches were used to recalibrate the baseline survival and the overall effect of the predictors of the models. We assessed the models' discrimination using C-index and then compared the observed with the predicted risk of death using calibration plots. The sensitivity and specificity of the models were estimated at the risk thresholds of 3%, 5%, 7%, and 10%. An agreement between models was assessed using the intra-class correlation coefficient (ICC). We applied decision analysis to provide perception into the consequences of using the models in general practice; for this reason, the clinical usefulness of the models was assessed using the net benefit (NB) and decision curve analysis. The NB is a sensitivity penalized by a weighted false positive (FP) rate in population level.
After 154 522 person-years of follow-up, 437 cardiovascular deaths (280 men) occurred. The 10-year observed risks were 4.2% (95% CI: 3.7%-4.8%) in men and 2.1% (1.8-2%.5%) in women. The c-index for SCORE function was 0.784 (0.756-0.812) in men and 0.780 (0.744-0.815) in women. Corresponding values for Globorisk were 0.793 (0.766- 0.820) and 0.793 (0.757-0.829). The deviation of the calibration slopes from one reflected a need for recalibration; after which, the predicted-to-observed ratio for both models was 1.02 in men and 0.95 in women. Models showed good agreement (ICC 0.93 in men, and 0.89 in women). Decision curve showed that using both models results in the same clinical usefulness at the risk threshold of 5%, in both men and women; however, at the risk threshold of 10%, Globorisk had better clinical usefulness in women (Difference: 8%, 95% CI: 4%-13%).
Original Globorisk and SCORE models overestimate the CVD risk in Iranian populations resulting in a high number of people who need intervention. Recalibration could adopt these models to precisely predict CVD mortality. Globorisk showed better performance clinically, only among high-risk women.
考虑到心血管疾病(CVD)风险预测对医疗保健系统的重要性,以及中东地区可用信息有限,我们评估了 SCORE 和 Globorisk 模型,以预测该地区一个国家的 CVD 死亡。
我们纳入了来自伊朗四个基于人群的队列的 24427 名 40-80 岁的参与者(11187 名男性)。采用更新方法对模型的基础生存和总体预测因子的效果进行重新校准。我们使用 C 指数评估模型的区分度,然后使用校准图比较观察到的和预测的死亡风险。使用 3%、5%、7%和 10%的风险阈值估计模型的敏感性和特异性。使用组内相关系数(ICC)评估模型之间的一致性。我们应用决策分析来了解在一般实践中使用模型的后果;出于这个原因,使用净效益(NB)和决策曲线分析评估了模型的临床实用性。NB 是人群水平上敏感性惩罚加权假阳性(FP)率的指标。
在 154522 人年的随访后,发生了 437 例心血管死亡(280 例男性)。男性的 10 年观察风险为 4.2%(95%CI:3.7%-4.8%),女性为 2.1%(1.8-2.5%)。SCORE 函数的 C 指数在男性为 0.784(0.756-0.812),在女性为 0.780(0.744-0.815)。Globorisk 的相应值分别为 0.793(0.766-0.820)和 0.793(0.757-0.829)。校准斜率与 1 的偏差反映了需要重新校准的情况;之后,两个模型的预测与观察比值在男性为 1.02,女性为 0.95。模型显示出良好的一致性(男性 ICC 为 0.93,女性为 0.89)。决策曲线显示,在男性和女性的 5%风险阈值下,使用两个模型具有相同的临床实用性;然而,在 10%的风险阈值下,Globorisk 在女性中的临床实用性更好(差异:8%,95%CI:4%-13%)。
原始的 Globorisk 和 SCORE 模型高估了伊朗人群的 CVD 风险,导致需要干预的人数众多。重新校准可以使这些模型更准确地预测 CVD 死亡率。Globorisk 在高危女性中具有更好的临床性能。