Department of Education and Humanities in Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan.
Graduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan.
PLoS One. 2023 Nov 2;18(11):e0278571. doi: 10.1371/journal.pone.0278571. eCollection 2023.
The current Objective Structured Clinical Examination (OSCE) is complex, costly, and difficult to provide high-quality assessments. This pilot study employed a focus group and debugging stage to test the Crowdsource Authoring Assessment Tool (CAAT) for the creation and sharing of assessment tools used in editing and customizing, to match specific users' needs, and to provide higher-quality checklists. Competency assessment international experts (n = 50) were asked to 1) participate in and experience the CAAT system when editing their own checklist, 2) edit a urinary catheterization checklist using CAAT, and 3) complete a Technology Acceptance Model (TAM) questionnaire consisting of 14 items to evaluate its four domains. The study occurred between October 2018 and May 2019. The median time for developing a new checklist using the CAAT was 65.76 minutes whereas the traditional method required 167.90 minutes. The CAAT system enabled quicker checklist creation and editing regardless of the experience and native language of participants. Participants also expressed the CAAT enhanced checklist development with 96% of them willing to recommend this tool to others. The use of a crowdsource authoring tool as revealed by this study has efficiently reduced the time to almost a third it would take when using the traditional method. In addition, it allows collaborations to partake on a simple platform which also promotes contributions in checklist creation, editing, and rating.
目前的客观结构化临床考试（OSCE）既复杂又昂贵，且难以提供高质量的评估。本试点研究采用焦点小组和调试阶段来测试众包创作评估工具（CAAT），以创建和共享评估工具，用于编辑和定制，以匹配特定用户的需求，并提供更高质量的清单。能力评估国际专家（n=50）被要求 1）在编辑自己的清单时参与并体验 CAAT 系统，2）使用 CAAT 编辑导尿清单，3）完成包含 14 个项目的技术接受模型（TAM）问卷，以评估其四个领域。研究于 2018 年 10 月至 2019 年 5 月进行。使用 CAAT 开发新清单的中位数时间为 65.76 分钟，而传统方法需要 167.90 分钟。CAAT 系统使清单的创建和编辑更快，无论参与者的经验和母语如何。参与者还表示，CAAT 增强了清单的开发，96%的人愿意将此工具推荐给他人。这项研究表明，众包创作工具的使用有效地将时间缩短到传统方法所需时间的近三分之一。此外，它允许协作在一个简单的平台上进行，这也促进了清单的创建、编辑和评分的贡献。
