User experience study to evaluate a clinical decision support system prototype supporting continuous kidney replacement therapy in a simulated ICU environment.

BACKGROUND

The increasing amount of data routinely collected on ICUs poses a challenge for clinicians which is aggravated with data-heavy therapies like Continuous Kidney Replacement Therapy (CKRT). We developed the CKRT Supporting Software Prototype (CKRT-SSP), a clinical decision support system for use before, during and after CKRT. The aim of this user experience (UX) study was to prospectively evaluate CKRT-SSP in terms of usability, user experience, and workload in a simulated ICU setting.

METHODS

We simulated CKRT treatments in a fully equipped single patient room in the ICU and evaluated CKRT-SSP using validated questionnaires: System Usability Scale (SUS) and User Experience Questionnaire (UEQ). Furthermore, a modified NASA-TLX (task load index) compared the workload before and after using CKRT-SSP. Twelve clinicians and nurses participated in this study.

RESULTS

The SUS reached a median value of 87.5 for CKRT-SSP, reflecting excellent usability. In the UEQ, CKRT-SSP scored clearly positive in the attractiveness dimension and the three task-related dimensions of clarity, efficiency, and dependability (95% CI fully > 0.8). For the two non-task-related dimensions, stimulation and novelty, there was a positive trend (mean > 0.8, lower limit of 95% CI < 0.8). The modified NASA-TLX suggests a trend to less total workload with CKRT-SSP which mainly is attributable to less physical demand and less effort.

CONCLUSION

CKRT-SSP is a promising tool for improving the workload in ICUs and the specific application of CKRT. We obtained valuable insights for further user-centric development.