Division of Cardiology, Centre Hospitalier Universitaire de Sherbrooke, Sherbrooke, Quebec, Canada.
Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Quebec, Canada.
BMC Med Res Methodol. 2020 Apr 5;20(1):75. doi: 10.1186/s12874-020-00953-9.
Postoperative atrial fibrillation (POAF) is a frequent complication of cardiac surgery associated with important morbidity, mortality, and costs. To assess the effectiveness of preventive interventions, an important prerequisite is to have access to accurate measures of POAF incidence. The aim of this study was to develop and validate such a measure.
A validation study was conducted at two large Canadian university health centers. First, a random sample of 976 (10.4%) patients who had cardiac surgery at these sites between 2010 and 2016 was generated. Then, a reference standard assessment of their medical records was performed to determine their true POAF status on discharge (positive/negative). The accuracy of various algorithms combining diagnostic and procedure codes from: 1) the current hospitalization, and 2) hospitalizations up to 6 years before the current hospitalization was assessed in comparison with the reference standard. Overall and site-specific estimates of sensitivity, specificity, positive (PPV), and negative (NPV) predictive values were generated, along with their 95%CIs.
Upon manual review, 324 (33.2%) patients were POAF-positive. Our best-performing algorithm combining data from both sites used a look-back window of 6 years to exclude patients previously known for AF. This algorithm achieved 70.4% sensitivity (95%CI: 65.1-75.3), 86.0% specificity (95%CI: 83.1-88.6), 71.5% PPV (95%CI: 66.2-76.4), and 85.4% NPV (95%CI: 82.5-88.0). However, significant site-specific differences in sensitivity and NPV were observed.
An algorithm based on administrative data can identify POAF patients with moderate accuracy. However, site-specific variations in coding practices have significant impact on accuracy.
术后心房颤动(POAF)是心脏手术后常见的并发症,与重要的发病率、死亡率和成本有关。为了评估预防干预措施的有效性,一个重要的前提是要有准确的 POAF 发生率衡量标准。本研究的目的是开发和验证这样一种衡量标准。
在加拿大的两个大型大学健康中心进行了一项验证研究。首先,从这些地点在 2010 年至 2016 年间进行心脏手术的患者中随机抽取了 976 名(10.4%)患者作为随机样本。然后,对他们的病历进行参考标准评估,以确定他们出院时的真实 POAF 状况(阳性/阴性)。与参考标准相比,评估了来自以下两个方面的各种诊断和程序代码算法的准确性:1)当前住院期间,以及 2)当前住院前 6 年的住院期间。生成了总体和特定站点的敏感性、特异性、阳性(PPV)和阴性(NPV)预测值的估计值及其 95%置信区间(CI)。
经手动审查,324 名(33.2%)患者 POAF 阳性。我们表现最好的算法结合了两个地点的数据,使用了 6 年的回溯窗口来排除以前患有 AF 的患者。该算法的敏感性为 70.4%(95%CI:65.1-75.3),特异性为 86.0%(95%CI:83.1-88.6),PPV 为 71.5%(95%CI:66.2-76.4),NPV 为 85.4%(95%CI:82.5-88.0)。然而,观察到敏感性和 NPV 存在显著的站点特异性差异。
基于行政数据的算法可以识别出具有中等准确性的 POAF 患者。然而,编码实践的特定站点差异对准确性有重大影响。