Rivers Zachary, Roth Joshua A, Wright Winona, Rim Sun Hee, Richardson Lisa C, Thomas Cheryll C, Townsend Julie S, Ramsey Scott D
Division of Public Health Sciences and Hutchinson Institute for Cancer Outcomes Research, Fred Hutchinson Cancer Center, Seattle, WA, USA.
Director, Value and Evidence, Hematology and Biosimilars, Pfizer, New York, NY, USA.
MDM Policy Pract. 2023 Feb 9;8(1):23814683231153378. doi: 10.1177/23814683231153378. eCollection 2023 Jan-Jun.
The complexity of decision science models may prevent their use to assist in decision making. User-centered design (UCD) principles provide an opportunity to engage end users in model development and refinement, potentially reducing complexity and increasing model utilization in a practical setting. We report our experiences with UCD to develop a modeling tool for cancer control planners evaluating cancer survivorship interventions. Using UCD principles (described in the article), we developed a dynamic cohort model of cancer survivorship for individuals with female breast, colorectal, lung, and prostate cancer over 10 y. Parameters were obtained from the National Program of Cancer Registries and peer-reviewed literature, with model outcomes captured in quality-adjusted life-years and net monetary benefit. Prototyping and iteration were conducted with structured focus groups involving state cancer control planners and staff from the Centers for Disease Control and Prevention and the American Public Health Association. Initial feedback highlighted model complexity and unclear purpose as barriers to end user uptake. Revisions addressed complexity by simplifying model input requirements, providing clear examples of input types, and reducing complex language. Wording was added to the results page to explain the interpretation of results. After these updates, feedback demonstrated that end users more clearly understood how to use and apply the model for cancer survivorship resource allocation tasks. A UCD approach identified challenges faced by end users in integrating a decision aid into their workflow. This approach created collaboration between modelers and end users, tailoring revisions to meet the needs of the users. Future models developed for individuals without a decision science background could leverage UCD to ensure the model meets the needs of the intended audience.
Model complexity and unclear purpose are 2 barriers that prevent lay users from integrating decision science tools into their workflow.Modelers could integrate the user-centered design framework when developing a model for lay users to reduce complexity and ensure the model meets the needs of the users.
决策科学模型的复杂性可能会阻碍其用于辅助决策。以用户为中心的设计(UCD)原则提供了一个让终端用户参与模型开发和完善的机会,有可能降低复杂性并提高模型在实际环境中的利用率。我们报告了我们运用UCD开发一个用于癌症控制规划者评估癌症幸存者干预措施的建模工具的经验。运用UCD原则(如文章中所述),我们为患有女性乳腺癌、结直肠癌、肺癌和前列腺癌的个体开发了一个为期10年的癌症幸存者动态队列模型。参数取自国家癌症登记计划和同行评审文献,模型结果以质量调整生命年和净货币效益来体现。通过由州癌症控制规划者以及疾病控制与预防中心和美国公共卫生协会的工作人员组成的结构化焦点小组进行了原型设计和迭代。初步反馈强调模型复杂性和目的不明确是终端用户采用的障碍。修订通过简化模型输入要求、提供输入类型的清晰示例以及减少复杂语言来解决复杂性问题。在结果页面添加了措辞以解释结果的解读。经过这些更新后,反馈表明终端用户更清楚地理解了如何使用该模型并将其应用于癌症幸存者资源分配任务。UCD方法识别出了终端用户在将决策辅助工具整合到其工作流程中所面临的挑战。这种方法在建模者和终端用户之间建立了协作,根据用户需求定制修订。为没有决策科学背景的个体开发的未来模型可以利用UCD来确保模型满足目标受众的需求。
模型复杂性和目的不明确是阻碍普通用户将决策科学工具整合到其工作流程中的两个障碍。建模者在为普通用户开发模型时可以整合以用户为中心的设计框架,以降低复杂性并确保模型满足用户需求。