Ng Hannah Jia Hui, Kansal Amit, Abdul Naseer Jishana Farhad, Hing Wee Chuan, Goh Carmen Jia Man, Poh Hermione, D'souza Jared Louis Andre, Lim Er Luen, Tan Gamaliel
Department of Medical Informatics, Ng Teng Fong General Hospital, Singapore, Singapore.
JAMIA Open. 2023 Aug 1;6(3):ooad056. doi: 10.1093/jamiaopen/ooad056. eCollection 2023 Oct.
Clinical decision support (CDS) alerts can aid in improving patient care. One CDS functionality is the Best Practice Advisory (BPA) alert notification system, wherein BPA alerts are automated alerts embedded in the hospital's electronic medical records (EMR). However, excessive alerts can change clinician behavior; redundant and repetitive alerts can contribute to alert fatigue. Alerts can be optimized through a multipronged strategy. Our study aims to describe these strategies adopted and evaluate the resultant BPA alert optimization outcomes.
This retrospective single-center study was done at Jurong Health Campus. Aggregated, anonymized data on patient demographics and alert statistics were collected from January 1, 2018 to December 31, 2021. "Preintervention" period was January 1-December 31, 2018, and "postintervention" period was January 1-December 31, 2021. The intervention period was the intervening period. Categorical variables were reported as frequencies and proportions and compared using the chi-square test. Continuous data were reported as median (interquartile range, IQR) and compared using the Wilcoxon rank-sum test. Statistical significance was defined at <.05.
There was a significant reduction of 59.6% in the total number of interruptive BPA alerts, despite an increase in the number of unique BPAs from 54 to 360 from pre- to postintervention. There was a 74% reduction in the number of alerts from the 7 BPAs that were optimized from the pre- to postintervention period. There was a significant increase in percentage of overall interruptive BPA alerts with action taken (8 [IQR 7.7-8.4] to 54.7 [IQR 52.5-58.9], -value < .05) and optimized BPAs with action taken (32.6 [IQR 32.3-32.9] to 72.6 [IQR 64.3-73.4], -value < .05). We estimate that the reduction in alerts saved 3600 h of providers' time per year.
A significant reduction in interruptive alert volume, and a significant increase in action taken rates despite manifold increase in the number of unique BPAs could be achieved through concentrated efforts focusing on governance, data review, and visualization using a system-embedded tool, combined with the CDS Five Rights framework, to optimize alerts. Improved alert compliance was likely multifactorial-due to decreased repeated alert firing for the same patient; better awareness due to stakeholders' involvement; and less fatigue since unnecessary alerts were removed. Future studies should prospectively focus on patients' clinical chart reviews to assess downstream effects of various actions taken, identify any possibility of harm, and collect end-user feedback regarding the utility of alerts.
临床决策支持(CDS)警报有助于改善患者护理。CDS的一项功能是最佳实践建议(BPA)警报通知系统,其中BPA警报是嵌入医院电子病历(EMR)中的自动警报。然而,过多的警报可能会改变临床医生的行为;冗余和重复的警报会导致警报疲劳。可通过多管齐下的策略优化警报。我们的研究旨在描述所采用的这些策略,并评估由此产生的BPA警报优化结果。
这项回顾性单中心研究在裕廊健康园区进行。收集了2018年1月1日至2021年12月31日期间汇总的、匿名的患者人口统计学数据和警报统计数据。“干预前”时期为2018年1月1日至12月31日,“干预后”时期为2021年1月1日至12月31日。干预期为中间时期。分类变量以频率和比例报告,并使用卡方检验进行比较。连续数据以中位数(四分位间距,IQR)报告,并使用Wilcoxon秩和检验进行比较。统计学显著性定义为<.05。
尽管从干预前到干预后,唯一BPA的数量从5个增加到360个,但中断性BPA警报的总数显著减少了59.6%。从干预前到干预后优化的7个BPA的警报数量减少了74%。采取行动的总体中断性BPA警报的百分比显著增加(从8[IQR 7.7 - 8.4]到54.7[IQR 52.5 - 58.9],P值<.05),采取行动的优化BPA的百分比也显著增加(从32.6[IQR 32.3 - 32.9]到72.6[IQR 64.3 - 73.4],P值<.05)。我们估计,警报的减少每年为医护人员节省了3600小时的时间。
通过集中精力进行治理、数据审查以及使用系统嵌入式工具进行可视化,并结合CDS五权框架来优化警报,可以显著减少中断性警报数量,尽管唯一BPA的数量大幅增加,但采取行动的比率仍显著提高。警报合规性的改善可能是多因素导致的,包括同一患者重复警报触发次数减少;利益相关者参与提高了意识;以及去除不必要警报后疲劳感减轻。未来的研究应前瞻性地关注患者临床病历审查,以评估所采取各种行动的下游影响,识别任何潜在危害,并收集最终用户对警报效用的反馈。