Kennedy Ann Blair, Riyad Cindy Nessim Youssef, Ellis Ryan, Fleming Perry R, Gainey Mallorie, Templeton Kara, Nourse Anna, Hardaway Virginia, Brown April, Evans Pam, Natafgi Nabil
Biomedical Sciences Department, School of Medicine Greenville, University of South Carolina, Greenville, SC, United States.
Patient Engagement Studio, University of South Carolina, Greenville, SC, United States.
J Particip Med. 2022 Aug 30;14(1):e38209. doi: 10.2196/38209.
Standardized patients (SPs) are essential stakeholders in the multiple mini interviews (MMIs) that are increasingly used to assess medical school applicants' interpersonal skills. However, there is little evidence for their inclusion in the development of instruments.
This study aimed to describe the process and evaluate the impact of having SPs co-design and cocreate a global measurement question that assesses medical school applicants' readiness for medical school and acceptance status.
This study used an exploratory, sequential, and mixed methods study design. First, we evaluated the initial MMI program and determined the next quality improvement steps. Second, we held a collaborative workshop with SPs to codevelop the assessment question and response options. Third, we evaluated the created question and the additional MMI rubric items through statistical tests based on 1084 applicants' data from 3 cohorts of applicants starting in the 2018-2019 academic year. The internal reliability of the MMI was measured using a Cronbach α test, and its prediction of admission status was tested using a forward stepwise binary logistic regression.
Program evaluation indicated the need for an additional quantitative question to assess applicant readiness for medical school. In total, 3 simulation specialists, 2 researchers, and 21 SPs participated in a workshop leading to a final global assessment question and responses. The Cronbach α's were >0.8 overall and in each cohort year. The final stepwise logistic model for all cohorts combined was statistically significant (P<.001), explained 9.2% (R) of the variance in acceptance status, and correctly classified 65.5% (637/972) of cases. The final model consisted of 3 variables: empathy, rank of readiness, and opening the encounter.
The collaborative nature of this project between stakeholders, including nonacademics and researchers, was vital for the success of this project. The SP-created question had a significant impact on the final model predicting acceptance to medical school. This finding indicates that SPs bring a critical perspective that can improve the process of evaluating medical school applicants.
标准化病人（SPs）是多重迷你面试（MMIs）中的重要利益相关者，多重迷你面试越来越多地用于评估医学院申请者的人际沟通技巧。然而，几乎没有证据表明在测评工具的开发中纳入了标准化病人。
本研究旨在描述标准化病人共同设计并共同创建一个整体测评问题的过程，并评估其对医学院申请者入学准备情况及录取状态评估的影响，该问题用于评估医学院申请者进入医学院的准备情况和录取状态。
本研究采用探索性、序列性和混合方法的研究设计。首先，我们评估了最初的多重迷你面试项目，并确定了下一步的质量改进措施。其次，我们与标准化病人举办了一次协作研讨会，共同开发评估问题和回答选项。第三，我们基于2018 - 2019学年开始的3个申请者队列中1084名申请者的数据，通过统计测试评估所创建的问题和额外的多重迷你面试评分标准项目。使用克朗巴哈α检验测量多重迷你面试的内部信度，并使用向前逐步二元逻辑回归测试其对录取状态的预测。
项目评估表明需要一个额外的定量问题来评估申请者进入医学院的准备情况。共有3名模拟专家、2名研究人员和21名标准化病人参加了一个研讨会，最终形成了一个整体评估问题及回答。总体及每个队列年份的克朗巴哈α系数均>0.8。所有队列合并后的最终逐步逻辑模型具有统计学意义（P<0.001），解释了录取状态方差的9.2%（R），并正确分类了65.5%（637/972）的病例。最终模型由3个变量组成：同理心、准备程度排名和开启交流环节。
包括非专业人员和研究人员在内的利益相关者之间的协作性质对本项目的成功至关重要。标准化病人创建的问题对预测医学院录取的最终模型有显著影响。这一发现表明标准化病人带来了关键视角，可改进医学院申请者的评估过程。
