Ayre Julie, Muscat Danielle M, Mac Olivia, Bonner Carissa, Dunn Adam G, Dalmazzo Jason, Mouwad Dana, McCaffery Kirsten
Sydney Health Literacy Lab, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, NSW, Australia.
Menzies Centre for Health Policy and Economics, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia.
PEC Innov. 2023 May 9;2:100162. doi: 10.1016/j.pecinn.2023.100162. eCollection 2023 Dec.
The Sydney Health Literacy Lab (SHeLL) Editor is an online text-editing tool that provides real-time assessment and feedback on written health information (assesses grade reading score, complex language, passive voice). This study aimed to explore how the design could be further enhanced to help health information providers interpret and act on automated feedback.
The prototype was iteratively refined across four rounds of user-testing with health services staff ( = 20). Participants took part in online interviews and a brief follow-up survey using validated usability scales (System Usability Scale, Technology Acceptance Model). After each round, Yardley's (2021) optimisation criteria guided which changes would be implemented.
Participants rated the Editor as having adequate usability (M = 82.8 out of 100, SD = 13.5). Most modifications sought to reduce information overload (e.g. simplifying instructions for new users) or make feedback motivating and actionable (e.g. using frequent incremental feedback to highlight changes to the text altered assessment scores).
terative user-testing was critical to balancing academic values and the practical needs of the Editor's target users. The final version emphasises actionable real-time feedback and not just assessment.
The Editor is a new tool that will help health information providers apply health literacy principles to written text.
悉尼健康素养实验室（SHeLL）编辑器是一种在线文本编辑工具，可对书面健康信息提供实时评估和反馈（评估年级阅读分数、复杂语言、被动语态）。本研究旨在探讨如何进一步改进该设计，以帮助健康信息提供者解读自动反馈并据此采取行动。
通过对20名卫生服务人员进行四轮用户测试，对该原型进行了迭代优化。参与者参加了在线访谈，并使用经过验证的可用性量表（系统可用性量表、技术接受模型）进行了简短的后续调查。在每一轮测试之后，亚德雷（2021年）的优化标准指导了哪些更改将被实施。
参与者对该编辑器的可用性评价较高（平均分为82.8分，满分100分，标准差为13.5）。大多数修改旨在减少信息过载（例如简化新用户的说明）或使反馈具有激励性和可操作性（例如使用频繁的增量反馈来突出文本更改对评估分数的影响）。
迭代用户测试对于平衡学术价值和编辑器目标用户的实际需求至关重要。最终版本强调可操作的实时反馈，而不仅仅是评估。
该编辑器是一种新工具，将帮助健康信息提供者将健康素养原则应用于书面文本。
