Rogausch Anja, Beyeler Christine, Montagne Stephanie, Jucker-Kupper Patrick, Berendonk Christoph, Huwendiek Sören, Gemperli Armin, Himmel Wolfgang
Department of Assessment and Evaluation, Institute of Medical Education, University of Bern, Bern, Switzerland.
Clinic Sonnenhalde, Riehen, Switzerland.
BMC Med Educ. 2015 Nov 25;15:208. doi: 10.1186/s12909-015-0490-3.
In contrast to objective structured clinical examinations (OSCEs), mini-clinical evaluation exercises (mini-CEXs) take place at the clinical workplace. As both mini-CEXs and OSCEs assess clinical skills, but within different contexts, this study aims at analyzing to which degree students' mini-CEX scores can be predicted by their recent OSCE scores and/or context characteristics.
Medical students participated in an end of Year 3 OSCE and in 11 mini-CEXs during 5 different clerkships of Year 4. The students' mean scores of 9 clinical skills OSCE stations and mean 'overall' and 'domain' mini-CEX scores, averaged over all mini-CEXs of each student were computed. Linear regression analyses including random effects were used to predict mini-CEX scores by OSCE performance and characteristics of clinics, trainers, students and assessments.
A total of 512 trainers in 45 clinics provided 1783 mini-CEX ratings for 165 students; OSCE results were available for 144 students (87%). Most influential for the prediction of 'overall' mini-CEX scores was the trainers' clinical position with a regression coefficient of 0.55 (95%-CI: 0.26-0.84; p < .001) for residents compared to heads of department. Highly complex tasks and assessments taking place in large clinics significantly enhanced 'overall' mini-CEX scores, too. In contrast, high OSCE performance did not significantly increase 'overall' mini-CEX scores.
In our study, Mini-CEX scores depended rather on context characteristics than on students' clinical skills as demonstrated in an OSCE. Ways are discussed which focus on either to enhance the scores' validity or to use narrative comments only.
与客观结构化临床考试(OSCE)不同,迷你临床评估练习(mini-CEX)在临床工作场所进行。由于mini-CEX和OSCE都评估临床技能,但在不同背景下进行,本研究旨在分析学生的近期OSCE成绩和/或背景特征能在多大程度上预测他们的mini-CEX成绩。
医学生参加了三年级末的OSCE,并在四年级的5次不同实习期间参加了11次mini-CEX。计算了学生在9个临床技能OSCE站点的平均成绩,以及每个学生所有mini-CEX的平均“总体”和“领域”mini-CEX成绩。使用包括随机效应的线性回归分析,通过OSCE表现以及诊所、培训师、学生和评估的特征来预测mini-CEX成绩。
45个诊所的512名培训师为165名学生提供了1783次mini-CEX评分;144名学生(87%)有OSCE成绩。对“总体”mini-CEX成绩预测最有影响的是培训师的临床职位,与科室主任相比,住院医师的回归系数为0.55(95%置信区间:0.26 - 0.84;p <.001)。在大型诊所进行的高度复杂任务和评估也显著提高了“总体”mini-CEX成绩。相比之下,高OSCE成绩并没有显著提高“总体”mini-CEX成绩。
在我们的研究中,Mini-CEX成绩更多地取决于背景特征,而非如OSCE中所展示的学生临床技能。文中讨论了一些方法,这些方法要么侧重于提高成绩的有效性,要么仅使用叙述性评论。