Kavanagh Meaghan E, Chiavaroli Laura, Glenn Andrea J, Heijmans Genevieve, Grant Shannan M, Chow Chi-Ming, Josse Robert G, Malik Vasanti S, Watson William, Lofters Aisha, Holmes Candice, Rackal Julia, Srichaikul Kristie, Sherifali Diana, Snelgrove-Clarke Erna, Udell Jacob A, Juni Peter, Booth Gillian L, Farkouh Michael E, Leiter Lawrence A, Kendall Cyril W C, Jenkins David J A, Sievenpiper John L
Department of Nutritional Sciences, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
Clinical Nutrition and Risk Factor Modification Center, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada.
JMIR Hum Factors. 2022 Apr 21;9(2):e34704. doi: 10.2196/34704.
The Portfolio Diet, or Dietary Portfolio, is a therapeutic dietary pattern that combines cholesterol-lowering foods to manage dyslipidemia for the prevention of cardiovascular disease. To translate the Portfolio Diet for primary care, we developed the PortfolioDiet.app as a patient and physician educational and engagement tool for PCs and smartphones. The PortfolioDiet.app is currently being used as an add-on therapy to the standard of care (usual care) for the prevention of cardiovascular disease in primary care. To enhance the adoption of this tool, it is important to ensure that the PortfolioDiet.app meets the needs of its target end users.
The main objective of this project is to undertake user testing to inform modifications to the PortfolioDiet.app as part of ongoing engagement in quality improvement (QI).
We undertook a 2-phase QI project from February 2021 to September 2021. We recruited users by convenience sampling. Users included patients, family physicians, and dietitians, as well as nutrition and medical students. For both phases, users were asked to use the PortfolioDiet.app daily for 7 days. In phase 1, a mixed-form questionnaire was administered to evaluate the users' perceived acceptability, knowledge acquisition, and engagement with the PortfolioDiet.app. The questionnaire collected both quantitative and qualitative data, including 2 open-ended questions. The responses were used to inform modifications to the PortfolioDiet.app. In phase 2, the System Usability Scale was used to assess the usability of the updated PortfolioDiet.app, with a score higher than 70 being considered acceptable.
A total of 30 and 19 users were recruited for phase 1 and phase 2, respectively. In phase 1, the PortfolioDiet.app increased users' perceived knowledge of the Portfolio Diet and influenced their perceived food choices. Limitations identified by users included challenges navigating to resources and profile settings, limited information on plant sterols, inaccuracies in points, timed-logout frustration, request for step-by-step pop-up windows, and request for a mobile app version; when looking at positive feedback, the recipe section was the most commonly praised feature. Between the project phases, 6 modifications were made to the PortfolioDiet.app to incorporate and address user feedback. At phase 2, the average System Usability Scale score was 85.39 (SD 11.47), with 100 being the best possible.
By undertaking user testing of the PortfolioDiet.app, its limitations and strengths were able to be identified, informing modifications to the application, which resulted in a clinical tool that better meets users' needs. The PortfolioDiet.app educates users on the Portfolio Diet and is considered acceptable by users. Although further refinements to the PortfolioDiet.app will continue to be made before its evaluation in a clinical trial, the result of this QI project is an improved clinical tool.
组合饮食法,即膳食组合,是一种治疗性饮食模式,它将降胆固醇食物结合起来以管理血脂异常,预防心血管疾病。为了将组合饮食法应用于初级保健,我们开发了PortfolioDiet.app,作为面向个人电脑和智能手机的患者及医生教育与参与工具。目前,PortfolioDiet.app正被用作初级保健中预防心血管疾病的标准治疗(常规治疗)的辅助疗法。为了提高该工具的采用率,确保PortfolioDiet.app满足其目标终端用户的需求非常重要。
本项目的主要目标是进行用户测试,为PortfolioDiet.app的改进提供依据,这是持续质量改进(QI)工作的一部分。
我们在2021年2月至2021年9月开展了一个两阶段的QI项目。我们通过便利抽样招募用户。用户包括患者、家庭医生、营养师以及营养和医学专业的学生。在两个阶段中,都要求用户连续7天每天使用PortfolioDiet.app。在第一阶段,发放了一份混合形式的问卷,以评估用户对PortfolioDiet.app的感知可接受性、知识获取情况以及参与度。该问卷收集了定量和定性数据,包括两个开放式问题。这些回答被用于指导对PortfolioDiet.app的改进。在第二阶段,使用系统可用性量表来评估更新后的PortfolioDiet.app的可用性,得分高于70被认为是可接受的。
第一阶段和第二阶段分别招募了30名和19名用户。在第一阶段,PortfolioDiet.app提高了用户对组合饮食法的感知知识,并影响了他们的感知食物选择。用户指出的局限性包括:导航到资源和个人资料设置有困难、植物甾醇信息有限、积分不准确、定时退出令人沮丧、需要逐步弹出窗口以及需要移动应用程序版本;从正面反馈来看,食谱部分是最常受到赞扬的功能。在项目阶段之间,对PortfolioDiet.app进行了6处修改,以纳入并回应用户反馈。在第二阶段,系统可用性量表的平均得分为85.39(标准差11.47),满分(最佳)为100分。
通过对PortfolioDiet.app进行用户测试,能够识别其局限性和优势,为应用程序的改进提供依据,从而得到一个更能满足用户需求的临床工具。PortfolioDiet.app对用户进行组合饮食法的教育,并且被用户认为是可接受的。尽管在临床试验评估之前,PortfolioDiet.app还会继续进行进一步完善,但这个QI项目的结果是一个经过改进的临床工具。