Department of Family and Emergency Medicine, Office of Education and Continuing Professional Development, VITAM Research Center, Université Laval, Quebec City, Quebec, Canada.
Department of Psychiatry and Neurosciences, Université Laval, Quebec City, Quebec, Canada.
Med Educ. 2022 Oct;56(10):1042-1050. doi: 10.1111/medu.14855. Epub 2022 Jun 22.
Given the widespread use of Multiple Mini Interviews (MMIs), their impact on the selection of candidates and the considerable resources invested in preparing and administering them, it is essential to ensure their quality. Given the variety of station formats used and the degree to which that factor resides in the control of training programmes that we know so little about, format's effect on MMI quality is a considerable oversight. This study assessed the effect of two popular station formats (interview vs. role-play) on the psychometric properties of MMIs.
We analysed candidate data from the first 8 years of the Integrated French MMIs (IF-MMI) (2010-2017, n = 11 761 applicants), an MMI organised yearly by three francophone universities and administered at four testing sites located in two Canadian provinces. There were 84 role-play and 96 interview stations administered, totalling 180 stations. Mixed design analyses of variance (ANOVAs) were used to test the effect of station format on candidates' scores and stations' discrimination. Cronbach's alpha coefficients for interview and role-play stations were also compared. Predictive validity of both station formats was estimated with a mixed multiple linear regression model testing the relation between interview and role-play scores with average clerkship performance for those who gained entry to medical school (n = 462).
Role-play stations (M = 20.67, standard deviation [SD] = 3.38) had a slightly lower mean score than interview stations (M = 21.36, SD = 3.08), p < 0.01, Cohen's d = 0.2. The correlation between role-play and interview stations scores was r = 0.5 (p < 0.01). Discrimination coefficients, Cronbach's alpha and predictive validity statistics did not vary by station format.
Interview and role-play stations have comparable psychometric properties, suggesting format to be interchangeable. Programmes should select station format based on match to the personal qualities for which they are trying to select.
鉴于多站式迷你面试（MMI）的广泛应用，以及其对候选人选拔的影响，以及在准备和管理面试中投入的大量资源，确保其质量至关重要。鉴于使用的站点格式种类繁多，以及该因素在我们知之甚少的培训计划的控制程度，格式对 MMI 质量的影响是一个相当大的疏忽。本研究评估了两种流行的站点格式（面试与角色扮演）对 MMIs 心理测量特性的影响。
我们分析了第一届法语整合多站式迷你面试（IF-MMI）（2010-2017 年，n=11761 名申请人）的考生数据，这是一个由三所法语大学组织的多站式迷你面试，在加拿大两个省的四个测试地点进行。共进行了 84 个角色扮演站和 96 个面试站，总计 180 个站。采用混合设计方差分析（ANOVA）来检验站点格式对考生分数和站点区分度的影响。还比较了访谈和角色扮演站的克朗巴赫 α系数。使用混合多元线性回归模型，通过测试进入医学院的考生（n=462）的面试和角色扮演分数与平均实习成绩之间的关系，估计了两种站点格式的预测有效性。
角色扮演站（M=20.67，标准差[SD]=3.38）的平均得分略低于面试站（M=21.36，SD=3.08），p<0.01，Cohen's d=0.2。角色扮演站和面试站得分之间的相关性 r=0.5（p<0.01）。区分系数、克朗巴赫 α 和预测有效性统计数据不因站点格式而异。
面试站和角色扮演站具有可比的心理测量特性，表明格式可以互换。计划应根据其试图选择的个人素质选择站点格式。
