Epithelial Biology Center, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Program in Chemical and Physical Biology, Vanderbilt University, Nashville, Tennessee, USA.
J Am Med Inform Assoc. 2021 Jun 12;28(6):1168-1177. doi: 10.1093/jamia/ocaa338.
The characteristics of clinician activities while interacting with electronic health record (EHR) systems can influence the time spent in EHRs and workload. This study aims to characterize EHR activities as tasks and define novel, data-driven metrics.
We leveraged unsupervised learning approaches to learn tasks from sequences of events in EHR audit logs. We developed metrics characterizing the prevalence of unique events and event repetition and applied them to categorize tasks into 4 complexity profiles. Between these profiles, Mann-Whitney U tests were applied to measure the differences in performance time, event type, and clinician prevalence, or the number of unique clinicians who were observed performing these tasks. In addition, we apply process mining frameworks paired with clinical annotations to support the validity of a sample of our identified tasks. We apply our approaches to learn tasks performed by nurses in the Vanderbilt University Medical Center neonatal intensive care unit.
We examined EHR audit logs generated by 33 neonatal intensive care unit nurses resulting in 57 234 sessions and 81 tasks. Our results indicated significant differences in performance time for each observed task complexity profile. There were no significant differences in clinician prevalence or in the frequency of viewing and modifying event types between tasks of different complexities. We presented a sample of expert-reviewed, annotated task workflows supporting the interpretation of their clinical meaningfulness.
The use of the audit log provides an opportunity to assist hospitals in further investigating clinician activities to optimize EHR workflows.
临床医生在与电子病历(EHR)系统交互时的活动特征会影响在 EHR 中的花费时间和工作量。本研究旨在将 EHR 活动描述为任务,并定义新的、数据驱动的指标。
我们利用无监督学习方法从 EHR 审核日志中的事件序列中学习任务。我们开发了描述独特事件和事件重复出现频率的指标,并将这些指标应用于将任务分类为 4 种复杂程度的类别。在这些类别之间,我们应用 Mann-Whitney U 检验来测量性能时间、事件类型和临床医生的差异,或观察到执行这些任务的独特临床医生的数量。此外,我们应用流程挖掘框架并结合临床注释来支持我们所识别任务的样本的有效性。我们将我们的方法应用于范德比尔特大学医学中心新生儿重症监护病房护士执行的任务中。
我们检查了 33 名新生儿重症监护病房护士生成的 EHR 审核日志,共产生了 57,234 次会话和 81 项任务。我们的结果表明,对于每个观察到的任务复杂程度类别,性能时间存在显著差异。不同复杂程度任务之间的临床医生的流行程度或查看和修改事件类型的频率没有显著差异。我们展示了一组经过专家审查和注释的任务工作流程,以支持对其临床意义的解释。
使用审核日志为医院提供了机会,以进一步调查临床医生的活动,优化 EHR 工作流程。