Wachter S Blake, Agutter Jim, Syroid Noah, Drews Frank, Weinger Matthew B, Westenskow Dwayne
Medical Inforamtics, University of Utah, Department of Anesthesiology, 3C444 SOM, 30 North 1900 East, Salt Lake City, UT 84132-2304, USA.
J Am Med Inform Assoc. 2003 Jul-Aug;10(4):363-72. doi: 10.1197/jamia.M1207. Epub 2003 Mar 28.
Data representations on today's medical monitors need to be improved to advance clinical awareness and prevent data vigilance errors. Simply building graphical displays does not ensure an improvement in clinical performance because displays have to be consistent with the user's clinical processes and mental models. In this report, the development of an original pulmonary graphical display for anesthesia is used as an example to show an iterative design process with built-in usability testing.
The process reported here is rapid, inexpensive, and requires a minimal number of subjects per development cycle. Three paper-based tests evaluated the anatomic, variable mapping, and graphical diagnostic meaning of the pulmonary display.
A confusion matrix compared the designer's intended answer with the subject's chosen answer. Considering deviations off the diagonal of the confusion matrix as design weaknesses, the pulmonary display was modified and retested. The iterative cycle continued until the anatomic and variable mapping cumulative test scores for a chosen design scored above 90% and the graphical diagnostic meaning test scored above 75%.
The iterative development test resulted in five design iterations. The final graphical pulmonary display improved the overall intuitiveness by 18%. The display was tested in three categories: anatomic features, variable mapping, and diagnostic accuracy. The anatomic intuitiveness increased by 25%, variable mapping intuitiveness increased by 34%, and diagnostic accuracy decreased slightly by 4%.
With this rapid iterative development process, an intuitive graphical display can be developed inexpensively prior to formal testing in an experimental setting.
当今医学监护仪上的数据呈现方式需要改进,以提高临床认知并防止数据警觉错误。仅仅构建图形显示并不能确保临床性能得到改善,因为显示必须与用户的临床流程和心理模型相一致。在本报告中,以一种原创的用于麻醉的肺部图形显示的开发为例,展示一个内置可用性测试的迭代设计过程。
这里所报告的过程快速、成本低,并且每个开发周期所需的受试者数量最少。三项基于纸质的测试评估了肺部显示的解剖结构、变量映射以及图形诊断意义。
一个混淆矩阵将设计者预期的答案与受试者选择的答案进行比较。将混淆矩阵非对角线上的偏差视为设计缺陷,对肺部显示进行修改并重新测试。迭代循环持续进行,直到所选设计的解剖结构和变量映射累积测试分数超过90%,且图形诊断意义测试分数超过75%。
迭代开发测试产生了五次设计迭代。最终的肺部图形显示将整体直观性提高了18%。该显示在三个类别中进行了测试:解剖特征、变量映射和诊断准确性。解剖直观性提高了25%,变量映射直观性提高了34%,诊断准确性略有下降,降低了4%。
通过这种快速迭代开发过程,可以在实验环境中进行正式测试之前,以低成本开发出直观的图形显示。