Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.
Acad Med. 2012 Oct;87(10):1330-4. doi: 10.1097/ACM.0b013e318267630f.
Traditional admissions personal interviews provide flexible faculty-student interactions but are plagued by low inter-interview reliability. Axelson and Kreiter (2009) retrospectively showed that multiple independent sampling (MIS) may improve reliability of personal interviews; thus, the authors incorporated MIS into the admissions process for medical students applying to the University of Toronto's Leadership Education and Development Program (LEAD). They examined the reliability and resource demands of this modified personal interview (MPI) format.
In 2010-2011, LEAD candidates submitted written applications, which were used to screen for participation in the MPI process. Selected candidates completed four brief (10-12 minutes) independent MPIs each with a different interviewer. The authors blueprinted MPI questions to (i.e., aligned them with) leadership attributes, and interviewers assessed candidates' eligibility on a five-point Likert-type scale. The authors analyzed inter-interview reliability using the generalizability theory.
Sixteen candidates submitted applications; 10 proceeded to the MPI stage. Reliability of the written application components was 0.75. The MPI process had overall inter-interview reliability of 0.79. Correlation between the written application and MPI scores was 0.49. A decision study showed acceptable reliability of 0.74 with only three MPIs scored using one global rating. Furthermore, a traditional admissions interview format would take 66% more time than the MPI format.
The MPI format, used during the LEAD admissions process, achieved high reliability with minimal faculty resources. The MPI format's reliability and effective resource use were possible through MIS and employment of expert interviewers. MPIs may be useful for other admissions tasks.
传统的招生个人面试提供了灵活的师生互动，但存在访谈间可靠性低的问题。Axelson 和 Kreiter（2009）回顾性地表明，多次独立抽样（MIS）可以提高个人面试的可靠性；因此，作者将 MIS 纳入了申请多伦多大学领导力教育与发展计划（LEAD）的医学生招生流程。他们检验了这种改良的个人面试（MPI）形式的可靠性和资源需求。
在 2010-2011 年，LEAD 候选人提交书面申请，用于筛选参加 MPI 流程的人选。入选的候选人每人完成四次简短的（10-12 分钟）独立 MPI，每次与不同的面试官进行。作者为 MPI 问题制定蓝图（即与领导力特质相匹配），面试官根据五点 Likert 量表评估候选人的资格。作者使用概化理论分析访谈间的可靠性。
有 16 名候选人提交了申请；10 名候选人进入了 MPI 阶段。书面申请部分的可靠性为 0.75。MPI 流程的总体访谈间可靠性为 0.79。书面申请和 MPI 得分之间的相关性为 0.49。决策研究表明，仅使用三个 MPI 进行一次整体评分，具有 0.74 的可接受可靠性。此外，MPI 格式比传统的招生面试格式节省 66%的时间。
在 LEAD 招生流程中使用的 MPI 格式，在最小的师资资源投入下实现了高可靠性。通过 MIS 和使用专家面试官，MPI 格式实现了可靠性和有效的资源利用。MPI 可能对其他招生任务有用。
