Patterson Fiona, Rowett Emma, Hale Robert, Grant Marcia, Roberts Chris, Cousans Fran, Martin Stuart
Work Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK.
Psychology Department, University of Cambridge, Downing Street, Cambridge, CB2 3EB, UK.
BMC Med Educ. 2016 Mar 9;16:87. doi: 10.1186/s12909-016-0606-4.
Evidence for the predictive validity of situational judgement tests (SJTs) and multiple-mini interviews (MMIs) is well-established in undergraduate selection contexts, however at present there is less evidence to support the validity of their use in postgraduate settings. More research is also required to assess the extent to which SJTs and MMIs are complementary for predicting performance in practice. This study represents the first longitudinal evaluation of the complementary roles and predictive validity of an SJT and an MMI for selection for entry into postgraduate General Practice (GP) specialty training in Australia.
Longitudinal data was collected from 443 GP registrars in Australia who were selected into GP training in 2010 or 2011. All 17 Regional Training Providers in Australia were asked to participate; performance data were received from 13 of these. Data was collected for participants' end-of-training assessment performance. Outcome measures include GP registrars' performance on the Royal Australian College of General Practitioners (RACGP) applied knowledge test, key feature problems and an objective structured clinical exam.
Performance on the SJT, MMI and the overall selection score significantly predicted all three end-of-training assessments (r = .12 to .54), indicating that both of the selection methods, as well the overall selection score, have good predictive validity. The SJT and MMI provide incremental validity over each other for two of the three end-of-training assessments.
The SJT and MMI were both significant positive predictors of all end-of-training assessments. Results provide evidence that they are complementary in predicting end-of-training assessment scores. This research adds to the limited literature at present regarding the predictive validity of postgraduate medical selection methods, and their comparable effectiveness when used in a single selection system. A future research agenda is proposed.
情境判断测试（SJTs）和多重迷你面试（MMIs）在本科招生背景下的预测效度已有充分证据，但目前支持其在研究生阶段使用效度的证据较少。还需要更多研究来评估SJTs和MMIs在预测实践表现方面的互补程度。本研究是对澳大利亚研究生全科医学（GP）专业培训入学选拔中SJT和MMI的互补作用及预测效度的首次纵向评估。
收集了443名2010年或2011年入选澳大利亚GP培训的注册医生的纵向数据。澳大利亚所有17个地区培训提供者都被邀请参与；其中13个提供了绩效数据。收集了参与者培训结束时评估表现的数据。结果指标包括GP注册医生在澳大利亚皇家全科医生学院（RACGP）应用知识测试、关键特征问题和客观结构化临床考试中的表现。
SJT、MMI及总体选拔分数的表现显著预测了所有三项培训结束时的评估（r = 0.12至0.54），表明这两种选拔方法以及总体选拔分数都具有良好的预测效度。在三项培训结束时的评估中，SJT和MMI对其中两项评估具有相互递增效度。
SJT和MMI都是所有培训结束时评估的显著正向预测指标。结果表明它们在预测培训结束时的评估分数方面具有互补性。本研究增加了目前关于研究生医学选拔方法预测效度及其在单一选拔系统中使用时可比有效性的有限文献。提出了未来的研究议程。
