Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, USA.
MCPHS University, Boston, Massachusetts, USA.
J Am Med Inform Assoc. 2021 Jun 12;28(6):1081-1087. doi: 10.1093/jamia/ocaa222.
To assess the appropriateness of medication-related clinical decision support (CDS) alerts associated with renal insufficiency and the potential/actual harm from overriding the alerts.
Override rate frequency was recorded for all inpatients who had a renal CDS alert trigger between 05/2017 and 04/2018. Two random samples of 300 for each of 2 types of medication-related CDS alerts associated with renal insufficiency-"dose change" and "avoid medication"-were evaluated by 2 independent reviewers using predetermined criteria for appropriateness of alert trigger, appropriateness of override, and patient harm.
We identified 37 100 "dose change" and 5095 "avoid medication" alerts in the population evaluated, and 100% of each were overridden. Dose change triggers were classified as 12.5% appropriate and overrides of these alerts classified as 90.5% appropriate. Avoid medication triggers were classified as 29.6% appropriate and overrides 76.5% appropriate. We identified 5 adverse drug events, and, of these, 4 of the 5 were due to inappropriately overridden alerts.
Alerts were nearly always presented inappropriately and were all overridden during the 1-year period studied. Alert fatigue resulting from receiving too many poor-quality alerts may result in failure to recognize errors that could lead to patient harm. Although medication-related CDS alerts associated with renal insufficiency had previously been found to be the most clinically beneficial alerts in a legacy system, in this system they were ineffective. These findings underscore the need for improvements in alert design, implementation, and monitoring of alert performance to make alerts more patient-specific and clinically appropriate.
评估与肾功能不全相关的药物相关临床决策支持(CDS)警报的适宜性,以及覆盖这些警报的潜在/实际危害。
记录了所有在 2017 年 5 月至 2018 年 4 月期间因肾功能 CDS 警报而触发的住院患者的覆盖率频率。使用预定的适宜性警报触发标准、覆盖适宜性和患者危害标准,对与肾功能不全相关的两种药物相关 CDS 警报(“剂量改变”和“避免药物”)的每个类型的随机抽取的 300 个样本进行了 2 位独立审查员的评估。
我们在评估的人群中发现了 37000 次“剂量改变”和 5095 次“避免药物”警报,并且每种警报都被完全覆盖。“剂量改变”警报被归类为 12.5%的适宜性,而这些警报的覆盖被归类为 90.5%的适宜性。“避免药物”警报被归类为 29.6%的适宜性,而覆盖被归类为 76.5%的适宜性。我们发现了 5 例不良药物事件,其中 5 例中的 4 例是由于不当覆盖警报所致。
在研究期间,警报几乎总是不适当的,并且都被覆盖了。由于接收到太多质量差的警报,导致警报疲劳,可能会导致未能识别可能导致患者伤害的错误。尽管与肾功能不全相关的药物相关 CDS 警报在遗留系统中被认为是最具临床效益的警报,但在这个系统中它们是无效的。这些发现强调了需要改进警报设计、实施和警报性能的监测,以使警报更具患者特异性和临床适宜性。