Richard L. Roudebush Veterans Affairs (VA) Medical Center, Department of Veterans Affairs, VA Health Services Research and Development Service (VA HSR&D), Center for Health Information and Communication, United States; Department of Pharmacy Practice, College of Pharmacy, Purdue University, West Lafayette, IN, United States; Regenstrief Institute, Inc., Indianapolis, IN, United States.
Department of Industrial Engineering, J.B. Speed School of Engineering, University of Louisville, Louisville, KY, United States; Center for Ergonomics, University of Louisville, Louisville, KY, United States.
J Biomed Inform. 2018 Feb;78:123-133. doi: 10.1016/j.jbi.2018.01.001. Epub 2018 Jan 9.
The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications.
可用性测试的质量高度依赖于相关的可用性场景。为了将可用性测试作为电子健康记录（EHR）认证的一部分进行推广，国家卫生信息技术协调员办公室（ONC）要求供应商与临床最终用户一起测试 EHR 的特定功能，并报告他们的可用性测试过程——包括使用的测试场景——以及结果。ONC 概述了可用性测试的基本期望，但在可用性文本或科学文献中，几乎没有关于如何为医疗保健应用程序开发可用性场景的指导。本文的目的是概述开发可用性场景和任务以评估基于计算机接口的健康信息技术时需要考虑的关键因素。为了实现这一目标，我们借鉴了我们在使用各种医疗保健应用程序和广泛的最终用户（包括医疗保健专业人员和患者）进行可用性测试方面十年的经验。我们讨论了影响场景开发的 10 个关键因素：可用性测试的目标；最终用户的角色；目标绩效目标；评估时间限制；临床重点；逼真度；与场景相关的偏差和混杂因素；嵌入式探针；最大限度地降低最终用户的风险；以及与医疗保健相关的结果衡量标准。对于每个因素，我们都提供了一个示例。本文旨在帮助可用性研究人员和从业者努力推进健康信息技术。本文提供了有关可用性场景开发的广泛指导，可以应用于广泛的临床信息系统和应用程序。
