Crowley Patrick, Kildedal Rasmus, Vindelev Simon Overvad, Jacobsen Sandra Schade, Larsen Jon Roslyng, Johansson Peter J, Aadahl Mette, Straker Leon, Stamatakis Emmanuel, Holtermann Andreas, Mork Paul Jarle, Gupta Nidhi
The National Research Centre for the Working Environment, Copenhagen, Denmark.
Department of Medical Sciences, Occupational and Environmental Medicine, Uppsala University, Uppsala, Sweden.
JMIR Form Res. 2023 Nov 17;7:e48209. doi: 10.2196/48209.
Device-based measurements of physical behavior, using the current methods, place a large burden on participants. The Motus system could reduce this burden by removing the necessity for in-person meetings, replacing diaries written on paper with digital diaries, and increasing the automation of feedback generation.
This study aims to describe the development of the Motus system and evaluate its potential to reduce participant burden in a two-phase usability evaluation.
Motus was developed around (1) a thigh-worn accelerometer with Bluetooth data transfer; (2) a smartphone app containing an attachment guide, a digital diary, and facilitating automated data transfer; (3) a cloud infrastructure for data storage; (4) an analysis software to generate feedback for participants; and (5) a web-based app for administrators. We recruited 19 adults with a mean age of 45 (SD 11; range 27-63) years, of which 11 were female, to assist in the two-phase evaluation of Motus. A total of 7 participants evaluated the usability of mockups for a smartphone app in phase 1. Participants interacted with the app while thinking aloud, and any issues raised were classified as critical, serious, or minor by observers. This information was used to create an improved and functional smartphone app for evaluation in phase 2. A total of 12 participants completed a 7-day free-living measurement with Motus in phase 2. On day 1, participants attempted 20 system-related tasks under observation, including registration on the study web page, reading the information letter, downloading and navigating the smartphone app, attaching an accelerometer on the thigh, and completing a diary entry for both work and sleep hours. Task completion success and any issues encountered were noted by the observer. On completion of the 7-day measurement, participants provided a rating from 0 to 100 on the System Usability Scale and participated in a semistructured interview aimed at understanding their experience in more detail.
The task completion rate for the 20 tasks was 100% for 13 tasks, >80% for 4 tasks, and <50% for 3 tasks. The average rating of system usability was 86 on a 0-100 scale. Thematic analysis indicated that participants perceived the system as easy to use and remember, and subjectively pleasing overall. Participants with shift work reported difficulty with entering sleep hours, and 66% (8/12) of the participants experienced slow data transfer between the app and the cloud infrastructure. Finally, a few participants desired a greater degree of detail in the generated feedback.
Our two-phase usability evaluation indicated that the overall usability of the Motus system is high in free-living. Issues around the system's slow data transfer, participants with atypical work shifts, and the degree of automation and detail of generated feedback should be addressed in future iterations of the Motus system.
INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/35697.
使用当前方法基于设备测量身体行为给参与者带来了很大负担。Motus系统可以通过消除面对面会议的必要性、用数字日记取代纸质日记以及提高反馈生成的自动化程度来减轻这种负担。
本研究旨在描述Motus系统的开发过程，并在两阶段可用性评估中评估其减轻参与者负担的潜力。
Motus系统围绕以下方面开发：（1）带有蓝牙数据传输功能的大腿佩戴式加速度计；（2）一款智能手机应用程序，包含附件指南、数字日记并便于自动数据传输；（3）用于数据存储的云基础设施；（4）为参与者生成反馈的分析软件；（5）面向管理员的基于网络的应用程序。我们招募了19名平均年龄为45岁（标准差11；范围27 - 63岁）的成年人，其中11名女性，以协助对Motus系统进行两阶段评估。在第一阶段，共有7名参与者评估智能手机应用程序原型的可用性。参与者在边思考边操作应用程序时，观察者将提出的任何问题分类为关键、严重或轻微问题。这些信息用于创建一个经过改进且功能完备的智能手机应用程序，以便在第二阶段进行评估。在第二阶段，共有12名参与者使用Motus系统进行了为期7天的自由生活测量。在第1天，参与者在观察下尝试了20项与系统相关的任务，包括在研究网页上注册、阅读信息信、下载并浏览智能手机应用程序、在大腿上佩戴加速度计以及记录工作和睡眠时间的日记条目。观察者记录任务完成情况以及遇到的任何问题。在7天测量结束时，参与者在系统可用性量表上给出了0至100的评分，并参加了旨在更详细了解他们体验的半结构化访谈。
20项任务中，13项任务的完成率为100%，4项任务的完成率大于80%，3项任务的完成率小于50%。系统可用性的平均评分为86分（满分100分）。主题分析表明，参与者认为该系统易于使用和记忆，总体上主观感觉良好。从事轮班工作的参与者报告在记录睡眠时间方面存在困难。66%（8/12）的参与者经历了应用程序与云基础设施之间的数据传输缓慢问题。最后，一些参与者希望生成的反馈能更详细一些。
我们的两阶段可用性评估表明，Motus系统在自由生活场景中的总体可用性较高。Motus系统未来的迭代版本应解决数据传输缓慢、非典型工作班次参与者以及生成反馈的自动化程度和详细程度等问题。
国际注册报告标识符（IRRID）：RR2 - 10.2196/35697。
