Simard Caroline, Côté Luc, de Bruyn Laurie, Lacasse Miriam
Université Laval.
MedEdPublish (2016). 2021 Jan 19;10:16. doi: 10.15694/mep.2021.000016.1. eCollection 2021.
This article was migrated. The article was marked as recommended. The Université Laval family medicine program has developed an innovative computerized tool called the criterion-based Competency Assessment Tool (CAT), currently undergoing validity assessment. This study followed a qualitative design assessing written comments collected in the assessment reports from the cohorts before and after the implementation of the CAT (n = 200, n = 200) in order to ascertain the tool's consequence validity. A deductive thematic content analysis was performed and pre- and post-implementation cohorts were compared. Overall feedback quality does not appear to have changed between cohorts. When analyzing CanMEDS roles separately, each is covered more often, but related comments appear to be less specific. The new report also seems to enable the teacher to tell more with the same number of words. Perhaps since the items are complete, exhaustive, and detailed enough to be self-explanatory, the tool helps the teacher to cover a wider area of competencies without the need to add many details with narrative comments. Consequence validity does not seem to have been substantially affected by changes in the family medicine resident's competency assessment, but the results do not support the contention that comment quality has improved either.
本文已迁移。该文章被标记为推荐文章。拉瓦尔大学家庭医学项目开发了一种名为基于标准的能力评估工具（CAT）的创新计算机化工具，目前正在进行效度评估。本研究采用定性设计，评估在CAT实施前后的队列评估报告中收集的书面评论（n = 200，n = 200），以确定该工具的结果效度。进行了演绎主题内容分析，并比较了实施前后的队列。总体反馈质量在各队列之间似乎没有变化。当分别分析CanMEDS角色时，每个角色被提及的频率更高，但相关评论似乎不那么具体。新报告似乎也使教师能够用相同数量的文字传达更多信息。也许由于项目完整、详尽且详细到足以自我解释，该工具帮助教师涵盖更广泛的能力领域，而无需通过叙述性评论添加许多细节。结果效度似乎并未因家庭医学住院医师能力评估的变化而受到实质性影响，但结果也不支持评论质量有所提高的观点。
