Manuel R Stephen, Dickens Lesley, Young Kathleen
University of Mississippi Medical Center, 2500 North State St., Jackson, MS 39216 USA.
Med Sci Educ. 2019 Jul 29;29(4):941-945. doi: 10.1007/s40670-019-00778-2. eCollection 2019 Dec.
Qualitative studies of the Multiple Mini Interview (MMI) have investigated the attitudes and thoughts of prospective students and interviewers (i.e., raters) on the MMI interview, but none have examined rater's written assessments. Concerns regarding what the MMI measures, especially across and within each interview, have sparked investigations to determine how and what raters are measuring. Raters communicate their student evaluation(s) through numerical ratings and written comments that provide score context. This study explores rater's written comments to better understand the specific information gathered during the MMI process that contributes to interviewee evaluations.
Randomized data from two US medical schools were examined with no numerical scores or other information about the interviewee provided to reviewers. In reviewing the rater comments, common words and phrases were identified to help construct themes that characterized the content (domains). Authors reviewed each other's notes and comments regarding themes and worked together to verify themes for accuracy.
Using a directed content approach to content analysis and reviewing the rater's comments, the results indicate that raters are focused on seven different domains: perspective taking, presentation, qualities, communication, coherence, comprehension, and non-verbal. Many of the rater comments contained multiple themes.
Raters' MMI comments provide the context for numerical scores allowing admissions committees to more fully understand a candidate's strengths or weaknesses. Identifying the themes in rater comments can ultimately assist the admissions committee to more comprehensively understand assessment elements that raters are using and consider important during the MMI evaluation.
多项迷你面试（MMI）的定性研究调查了准学生和面试官（即评分者）对MMI面试的态度和想法，但尚无研究考察评分者的书面评估。关于MMI衡量的内容，尤其是在每次面试之间和面试过程中的衡量内容的担忧，引发了相关调查，以确定评分者如何以及衡量什么。评分者通过数字评分和提供分数背景的书面评论来传达他们对学生的评估。本研究探讨评分者的书面评论，以更好地理解MMI过程中收集的有助于评估面试者的具体信息。
检查了来自美国两所医学院的随机数据，未向评审人员提供有关面试者的数字分数或其他信息。在审查评分者的评论时，识别出常见的单词和短语，以帮助构建表征内容（领域）的主题。作者相互审查了关于主题的笔记和评论，并共同努力验证主题的准确性。
采用定向内容分析法进行内容分析并审查评分者的评论，结果表明评分者关注七个不同的领域：换位思考、表达、品质、沟通、连贯性、理解和非语言。许多评分者的评论包含多个主题。
评分者的MMI评论为数字分数提供了背景信息，使招生委员会能够更全面地了解候选人的优势或劣势。识别评分者评论中的主题最终可以帮助招生委员会更全面地理解评分者在MMI评估过程中使用并认为重要的评估要素。
