Georgsson Mattias, Staggers Nancy
Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA; Faculty of Computing, Blekinge Institute of Technology, Karlskrona, Sweden.
Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA; College of Nursing, University of Utah, Salt Lake City, UT, USA.
J Biomed Inform. 2016 Feb;59:115-29. doi: 10.1016/j.jbi.2015.11.008. Epub 2015 Nov 27.
mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management.
A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification.
The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12).
Multiple data collection methods yielded a more comprehensive set of usability issues. Usability testing uncovered the largest volume of usability issues, followed by interviewing and then the questionnaire. The interview did not surface any unique consolidated usability issues while the questionnaire surfaced one. The FA and UPT were valuable in structuring and classifying problems. The resulting descriptions serve as a communication tool in problem solving and programming. We recommend the usage of multiple methods in data collection and employing the FA and UPT in data analyses for future usability testing.
移动健康系统在帮助患者进行糖尿病自我管理方面正变得越来越普遍，但最近的研究表明需要对患者体验到的可用性进行全面评估。当前的评估缺乏用于数据收集的多方法设计和用于数据分析的结构化方法。本研究的目的是对一种多方法进行可行性测试，该方法用于收集数据以及分析患者对用于2型糖尿病自我管理的移动健康系统体验到的可用性。
从一项更大规模的临床试验中随机抽取10名用户。数据收集方法包括使用八个代表性任务进行用户测试和出声思维协议、一次半结构化访谈以及一份关于患者使用该系统体验的问卷。使用框架分析（FA）方法和可用性问题分类法（UPT）来构建、编码和分析结果。分类后给出可用性严重程度评级。
综合方法共产生了117个问题，浓缩为19个可用性问题，平均严重程度评级为2.47或为严重。可用性测试检测到了50%的初始可用性问题，其次是访谈后检测到29%。可用性测试发现了19个合并的可用性问题中的18个，而问卷揭示了一个独特问题。患者在执行诸如添加、删除和导出血糖测量值等复杂任务时，在血糖读数视图中体验到的可用性问题最多（8个）。血糖日记视图、血糖读数视图和血压视图的严重程度评级最高，平均严重程度评级为3（严重）。大多数问题归类在UPT的人工制品组件以及视觉性（7个）和操作（6个）的主要类别下。在UPT任务组件中，大多数问题属于主要类别任务映射（12个）。
多种数据收集方法产生了更全面的可用性问题集。可用性测试发现的可用性问题数量最多，其次是访谈，然后是问卷。访谈未发现任何独特的合并可用性问题，而问卷发现了一个。FA和UPT在构建和分类问题方面很有价值。所得描述可作为解决问题和编程中的沟通工具。我们建议在未来的可用性测试中，在数据收集中使用多种方法，并在数据分析中采用FA和UPT。
