HIV Center for Clinical and Behavioral Studies, New York State Psychiatric Institute and Columbia University, New York, NY, United States; Department of Biomedical Informatics, Columbia University, New York, NY, United States.
J Biomed Inform. 2013 Dec;46(6):1080-7. doi: 10.1016/j.jbi.2013.08.001. Epub 2013 Aug 23.
Over two decades of research has been conducted using mobile devices for health related behaviors yet many of these studies lack rigor. There are few evaluation frameworks for assessing the usability of mHealth, which is critical as the use of this technology proliferates. As the development of interventions using mobile technology increase, future work in this domain necessitates the use of a rigorous usability evaluation framework.
We used two exemplars to assess the appropriateness of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating the usability of mHealth technology. In the first exemplar, we conducted 6 focus group sessions to explore adolescents' use of mobile technology for meeting their health Information needs. In the second exemplar, we conducted 4 focus group sessions following an Ecological Momentary Assessment study in which 60 adolescents were given a smartphone with pre-installed health-related applications (apps).
We coded the focus group data using the 9 concepts of the Health-ITUEM: Error prevention, Completeness, Memorability, Information needs, Flexibility/Customizability, Learnability, Performance speed, Competency, Other outcomes. To develop a finer granularity of analysis, the nine concepts were broken into positive, negative, and neutral codes. A total of 27 codes were created. Two raters (R1 and R2) initially coded all text and a third rater (R3) reconciled coding discordance between raters R1 and R2.
A total of 133 codes were applied to Exemplar 1. In Exemplar 2 there were a total of 286 codes applied to 195 excerpts. Performance speed, Other outcomes, and Information needs were among the most frequently occurring codes.
Our two exemplars demonstrated the appropriateness and usefulness of the Health-ITUEM in evaluating mobile health technology. Further assessment of this framework with other study populations should consider whether Memorability and Error prevention are necessary to include when evaluating mHealth technology.
尽管过去二十多年来已经使用移动设备进行了许多与健康相关的行为研究,但其中许多研究缺乏严谨性。目前评估移动医疗可用性的评估框架很少,这是至关重要的,因为这项技术的使用正在迅速普及。随着使用移动技术开发干预措施的工作不断增加,未来在这一领域的工作需要使用严格的可用性评估框架。
我们使用两个范例来评估健康信息技术可用性评估模型(Health-ITUEM)评估移动医疗技术可用性的适宜性。在第一个范例中,我们进行了 6 次焦点小组会议,探讨了青少年使用移动技术满足其健康信息需求的情况。在第二个范例中,我们进行了 4 次焦点小组会议,对 60 名青少年进行了生态瞬间评估研究,他们使用预先安装了健康相关应用程序(apps)的智能手机。
我们使用 Health-ITUEM 的 9 个概念对焦点小组数据进行编码:错误预防、完整性、可记性、信息需求、灵活性/可定制性、易学性、性能速度、能力、其他结果。为了进行更细粒度的分析,将这 9 个概念分为正面、负面和中性代码。总共创建了 27 个代码。两名评分员(R1 和 R2)首先对所有文本进行编码,第三名评分员(R3)协调了评分员 R1 和 R2 之间的编码分歧。
范例 1 共应用了 133 个代码。范例 2 共应用了 286 个代码,涉及 195 个片段。性能速度、其他结果和信息需求是最常出现的代码。
我们的两个范例证明了 Health-ITUEM 在评估移动健康技术方面的适宜性和有用性。应考虑用其他研究人群进一步评估该框架,以确定在评估移动医疗技术时是否需要包括可记性和错误预防。