American Board of Family Medicine, Lexington, Kentucky
Department of Family and Community Medicine, College of Medicine, University of Kentucky, Lexington, Kentucky.
Ann Fam Med. 2022 Mar-Apr;20(2):110-115. doi: 10.1370/afm.2770.
Physicians' use of self-assessment to guide quality improvement or board certification activities often does not correlate with more objective measures, and they may spend valuable time on activities that support their strengths instead of addressing gaps. Our objective was to study whether viewing quality measures, with peer comparisons, would affect the selection of certification activities.
We conducted a cluster-randomized controlled trial-the Trial of Data Exchange for Maintenance of certification and Raising Quality (TRADEMaRQ)-with 4 partner organizations during 2015-2017. Physicians were presented their quality data within their online certification portfolios before (intervention) vs after (control) they chose board certification activities. The primary outcome was whether the selected activity addressed a quality gap (a quality area in which the physician scored below the mean for the study population).
Of 2,570 invited physicians, 254 physicians completed the study: 130 in the intervention group and 124 in the control group. Nearly one-fifth of participating physicians did not complete any certification activities during the study. A sizable minority of those in the intervention group, 18.4%, never reviewed their quality dashboard. Overall, just 27.2% of completed certification activities addressed a quality gap, and there was no significant difference in this outcome in the intervention group vs the control group in either bivariate or adjusted analyses (odds ratio = 1.28; 95% CI, 0.90-1.82).
Physicians did not use quality performance data in choosing certification activities. Certification boards are being pressed to make their programs relevant to practice, less burdensome, and supportive of quality improvement in alignment with value-based payment models. Using practice data to drive certification choices would meet these goals.
医生使用自我评估来指导质量改进或委员会认证活动,通常与更客观的衡量标准不一致,而且他们可能会把宝贵的时间花在支持自己优势的活动上,而不是弥补差距。我们的目的是研究查看质量衡量标准并与同行进行比较是否会影响认证活动的选择。
我们在 2015 年至 2017 年期间,与 4 个合作组织进行了一项群组随机对照试验——维持认证和提高质量的数据交换试验(TRADEMaRQ)。在选择委员会认证活动之前(干预组)和之后(对照组),医生会在其在线认证组合中查看其质量数据。主要结果是选择的活动是否解决了质量差距(医生在研究人群中的得分低于平均值的质量领域)。
在受邀的 2570 名医生中,有 254 名医生完成了这项研究:干预组 130 名,对照组 124 名。在参与研究的医生中,近五分之一的人在研究期间没有完成任何认证活动。干预组中有相当一部分医生(18.4%)从未查看过他们的质量仪表板。总体而言,只有 27.2%的已完成的认证活动解决了质量差距,而且在单变量和调整分析中,干预组与对照组在这一结果上没有显著差异(比值比=1.28;95%置信区间,0.90-1.82)。
医生在选择认证活动时没有使用质量绩效数据。认证委员会正面临着使他们的计划与实践相关、减轻负担、并与基于价值的支付模式一致支持质量改进的压力。使用实践数据来推动认证选择将满足这些目标。