Department of Neurology, Massachusetts General Hospital, Boston, Massachusetts, USA.
Department of Neurology, Harvard Medical School, Boston, Massachusetts, USA.
J Am Geriatr Soc. 2021 Aug;69(8):2240-2251. doi: 10.1111/jgs.17183. Epub 2021 Apr 26.
BACKGROUND/OBJECTIVES: No data exist regarding the validity of International Classification of Disease (ICD)-10 dementia diagnoses against a clinician-adjudicated reference standard within Medicare claims data. We examined the accuracy of claims-based diagnoses with respect to expert clinician adjudication using a novel database with individual-level linkages between electronic health record (EHR) and claims.
In this retrospective observational study, two neurologists and two psychiatrists performed a standardized review of patients' medical records from January 2016 to December 2018 and adjudicated dementia status. We measured the accuracy of three claims-based definitions of dementia against the reference standard.
Mass-General-Brigham Healthcare (MGB), Massachusetts, USA.
From an eligible population of 40,690 fee-for-service (FFS) Medicare beneficiaries, aged 65 years and older, within the MGB Accountable Care Organization (ACO), we generated a random sample of 1002 patients, stratified by the pretest likelihood of dementia using administrative surrogates.
None.
We evaluated the accuracy (area under receiver operating curve [AUROC]) and calibration (calibration-in-the-large [CITL] and calibration slope) of three ICD-10 claims-based definitions of dementia against clinician-adjudicated standards. We applied inverse probability weighting to reconstruct the eligible population and reported the mean and 95% confidence interval (95% CI) for all performance characteristics, using 10-fold cross-validation (CV).
Beneficiaries had an average age of 75.3 years and were predominately female (59%) and non-Hispanic whites (93%). The adjudicated prevalence of dementia in the eligible population was 7%. The best-performing definition demonstrated excellent accuracy (CV-AUC 0.94; 95% CI 0.92-0.96) and was well-calibrated to the reference standard of clinician-adjudicated dementia (CV-CITL <0.001, CV-slope 0.97).
This study is the first to validate ICD-10 diagnostic codes against a robust and replicable approach to dementia ascertainment, using a real-world clinical reference standard. The best performing definition includes diagnostic codes with strong face validity and outperforms an updated version of a previously validated ICD-9 definition of dementia.
背景/目的:在医疗保险索赔数据中,针对临床医生裁定的参考标准,目前还没有关于国际疾病分类(ICD)-10 痴呆诊断的有效性的数据。我们使用具有电子健康记录(EHR)和索赔数据之间个体水平链接的新型数据库,检查了基于索赔的诊断与专家临床医生裁定的准确性。
在这项回顾性观察研究中,两名神经病学家和两名精神科医生对 2016 年 1 月至 2018 年 12 月期间的患者病历进行了标准化审查,并裁定了痴呆症的状况。我们使用参考标准衡量了三种基于索赔的痴呆定义的准确性。
马萨诸塞州总医院-布里格姆(MGB),美国马萨诸塞州。
在 MGB 负责医疗组织(ACO)中,我们从 40690 名符合条件的、年龄在 65 岁及以上的按服务收费(FFS)医疗保险受益人中,生成了一个由 1002 名患者组成的随机样本,该样本按使用行政替代指标确定的痴呆症的预先测试可能性进行分层。
无。
我们评估了三种基于 ICD-10 的痴呆症索赔定义(使用接收器工作特征曲线 [AUROC] 下面积)和校准(大校准 [CITL] 和校准斜率)与临床医生裁定标准的准确性。我们应用逆概率加权法重建合格人群,并使用 10 倍交叉验证(CV)报告所有性能特征的平均值和 95%置信区间(95%CI)。
受益人的平均年龄为 75.3 岁,主要是女性(59%)和非西班牙裔白人(93%)。在合格人群中,经裁定的痴呆症患病率为 7%。表现最好的定义表现出优异的准确性(CV-AUC 0.94;95%CI 0.92-0.96),并且与临床医生裁定的痴呆症参考标准很好地校准(CV-CITL <0.001,CV 斜率 0.97)。
这项研究是第一个使用现实世界的临床参考标准,针对痴呆症的发现,对 ICD-10 诊断代码进行验证的研究。表现最好的定义包括具有很强的表面效度的诊断代码,并且优于以前验证的 ICD-9 痴呆症定义的更新版本。