Rozenblum Ronen, Rodriguez-Monguio Rosa, Volk Lynn A, Forsythe Katherine J, Myers Sara, McGurrin Maria, Williams Deborah H, Bates David W, Schiff Gordon, Seoane-Vazquez Enrique
Jt Comm J Qual Patient Saf. 2020 Jan;46(1):3-10. doi: 10.1016/j.jcjq.2019.09.008. Epub 2019 Nov 27.
Clinical decision support (CDS) alerting tools can identify and reduce medication errors. However, they are typically rule-based and can identify only the errors previously programmed into their alerting logic. Machine learning holds promise for improving medication error detection and reducing costs associated with adverse events. This study evaluates the ability of a machine learning system (MedAware) to generate clinically valid alerts and estimates the cost savings associated with potentially prevented adverse events.
Alerts were generated retrospectively by the MedAware system on outpatient data from two academic medical centers between 2009 and 2013. MedAware alerts were compared to alerts in an existing CDS system. A random sample of 300 alerts was selected for medical record review. Frequency and severity of potential outcomes of alerted medication errors of medium and high clinical value were estimated, along with associated health care costs of these potentially prevented adverse events.
A total of 10,668 alerts were generated. Overall, 68.2% of MedAware alerts would not have been generated by the existing CDS system. Ninety-two percent of a random sample of the chart-reviewed alerts were accurate based on structured data available in the record, and 79.7% were clinically valid. Estimated cost of adverse events potentially prevented in an outpatient setting was more than $60 per drug alert and $1.3 million when extrapolating study findings to the full patient population.
A machine learning system identified clinically valid medication error alerts that might otherwise be missed with existing CDS systems. Estimates show potential for cost savings associated with potentially prevented adverse events.
临床决策支持(CDS)警报工具可识别并减少用药错误。然而,它们通常基于规则,只能识别预先编入其警报逻辑的错误。机器学习有望改善用药错误检测并降低与不良事件相关的成本。本研究评估了机器学习系统(MedAware)生成临床有效警报的能力,并估计了与潜在可预防不良事件相关的成本节约情况。
MedAware系统对2009年至2013年期间两个学术医疗中心的门诊数据进行回顾性警报生成。将MedAware警报与现有CDS系统中的警报进行比较。随机抽取300条警报进行病历审查。估计了具有中高临床价值的警报用药错误潜在结果的频率和严重程度,以及这些潜在可预防不良事件的相关医疗保健成本。
共生成10668条警报。总体而言,现有CDS系统不会生成68.2%的MedAware警报。根据病历中可用的结构化数据,随机抽取的经图表审查的警报中有92%是准确的,79.7%在临床上是有效的。在门诊环境中,潜在可预防的不良事件估计成本超过每条药物警报60美元,将研究结果外推至全部患者人群时为130万美元。
机器学习系统识别出了临床有效的用药错误警报,而现有CDS系统可能会遗漏这些警报。估计显示出与潜在可预防不良事件相关的成本节约潜力。