Developing, pilot testing, and refining requirements for 3 EHR-integrated interventions to improve diagnostic safety in acute care: a user-centered approach.

OBJECTIVE

To describe a user-centered approach to develop, pilot test, and refine requirements for 3 electronic health record (EHR)-integrated interventions that target key diagnostic process failures in hospitalized patients.

MATERIALS AND METHODS

Three interventions were prioritized for development: a Diagnostic Safety Column () within an EHR-integrated dashboard to identify at-risk patients; a Diagnostic Time-Out () for clinicians to reassess the working diagnosis; and a Patient Diagnosis Questionnaire () to gather patient concerns about the diagnostic process. Initial requirements were refined from analysis of test cases with elevated risk predicted by logic compared to risk perceived by a clinician working group; testing sessions with clinicians; responses from patients; and focus groups with clinicians and patient advisors using storyboarding to model the integrated interventions. Mixed methods analysis of participant responses was used to identify final requirements and potential implementation barriers.

RESULTS

Final requirements from analysis of 10 test cases predicted by the , 18 clinician participants, and 39 responses included the following: configurable parameters (variables, weights) to adjust baseline risk estimates in real-time based on new clinical data collected during hospitalization; more concise wording and flexibility for clinicians to conduct the with or without the patient present; and integration of responses into the to ensure closed-looped communication with clinicians. Analysis of focus groups confirmed that tight integration of the interventions with the EHR would be necessary to prompt clinicians to reconsider the working diagnosis in cases with elevated diagnostic error (DE) risk or uncertainty. Potential implementation barriers included alert fatigue and distrust of the risk algorithm (); time constraints, redundancies, and concerns about disclosing uncertainty to patients (); and patient disagreement with the care team's diagnosis ().

DISCUSSION

A user-centered approach led to evolution of requirements for 3 interventions targeting key diagnostic process failures in hospitalized patients at risk for DE.

CONCLUSIONS

We identify challenges and offer lessons from our user-centered design process.