Clinical Pharmacology and Toxicology Research, St Joseph's Healthcare Hamilton.
Faculty of Health Sciences, McMaster University.
Eval Health Prof. 2023 Sep;46(3):213-224. doi: 10.1177/01632787231165797. Epub 2023 Mar 23.
Objective Structured Clinical Examinations (OSCEs) and written tests are commonly used to assess health professional students, but it remains unclear whether the additional human resources and expenses required for OSCEs, both in-person and online, are worthwhile for assessing competencies. This scoping review summarized literature identified by searching MEDLINE and EMBASE comparing 1) OSCEs and written tests and 2) in-person and online OSCEs, for assessing health professional trainees' competencies. For Q1, 21 studies satisfied inclusion criteria. The most examined health profession was medical trainees (19, 90.5%), the comparison was most frequently OSCEs versus multiple-choice questions (MCQs) (18, 85.7%), and 18 (87.5%) examined the same competency domain. Most (77.5%) total score correlation coefficients between testing methods were weak ( < 0.40). For Q2, 13 articles were included. In-person and online OSCEs were most used for medical trainees (9, 69.2%), checklists were the most prevalent evaluation scheme (7, 63.6%), and 14/17 overall score comparisons were not statistically significantly different. Generally low correlations exist between MCQ and OSCE scores, providing insufficient evidence as to whether OSCEs provide sufficient value to be worth their additional cost. Online OSCEs may be a viable alternative to in-person OSCEs for certain competencies where technical challenges can be met.
客观结构化临床考试(OSCE)和笔试常用于评估卫生专业学生,但对于 OSCE 考试(无论是现场考试还是在线考试)在评估能力方面所需的额外人力资源和费用是否值得,仍不清楚。本范围综述总结了通过搜索 MEDLINE 和 EMBASE 确定的文献,比较了 1)OSCE 考试和笔试,2)现场和在线 OSCE 考试,用于评估卫生专业学员的能力。对于问题 1,有 21 项研究符合纳入标准。最受检查的卫生专业是医学实习生(19 项,90.5%),最常比较的是 OSCE 与多项选择题(MCQ)(18 项,85.7%),18 项(87.5%)检查了相同的能力领域。测试方法之间的大多数(77.5%)总分相关系数较弱(<0.40)。对于问题 2,有 13 篇文章被纳入。现场和在线 OSCE 最常用于医学实习生(9 项,69.2%),检查表是最普遍的评估方案(7 项,63.6%),14/17 项总体评分比较没有统计学差异。MCQ 和 OSCE 分数之间普遍存在低相关性,这表明 OSCE 考试是否具有足够的价值值得其额外成本,证据不足。对于某些可以克服技术挑战的能力,在线 OSCE 可能是现场 OSCE 的可行替代方案。