Faculty of Health and Medical Sciences, University of Surrey, Guildford, UK
Faculty of Health and Medical Sciences, University of Surrey, Guildford, UK.
BMJ Open. 2023 Oct 31;13(10):e074440. doi: 10.1136/bmjopen-2023-074440.
We aimed to explore the psychometric properties of the first known online asynchronous multiple mini-interview (MMI) designed for fairness with subgroup analyses by key characteristics, usability and acceptability.
Cross-discipline multimethod evaluation.
One UK University.
Applicants to nursing, midwifery and paramedic science undergraduate programmes during 2021-2022.
PRIMARY, SECONDARY OUTCOME MEASURES: Psychometric properties (internal consistency, construct validity, dimensionality) were assessed using Cronbach's alpha (α), parallel analysis (PA), Schmid-Leiman transformation and ordinal confirmatory factor analysis (CFA). Usability and acceptability were evaluated using descriptive statistics and conventional content analysis.
The system was configured in a seven question 4 min MMI. Applicants' videorecorded their answers which were later assessed by interviewers and scores summed. Applicants and interviewers completed online evaluation questionnaires.
Performance data from 712 applicants determined good-excellent reliability for the asynchronous MMI (mean α 0.72) with similar results across subgroups (gender, age, disability/support needs, UK/non-UK). PA and factor analysis results suggested there were seven factors relating to the MMI questions with an underlying general factor that explained the variance in observed candidate responses. A CFA testing a seven-factor hierarchical model showed an excellent fit to the data (Confirmatory Fit Index=0.99), Tucker Lewis Index=0.99, root mean square error (RMSE) =0.034). Applicants (n=210) viewed the flexibility, relaxed environment and cost savings advantageous. Interviewers (n=65) reported the system to be intuitive, flexible with >70% time saved compared with face-to-face interviews. Reduced personal communication was cited as the principal disadvantage.
We found that the asynchronous MMI was reliable, time-efficient, fair and acceptable and building fairness in was lost-cost. These novel, insights are applicable across health professions selection internationally informing the future configuration of online interviews to ensure workforces represent the societies they serve.
我们旨在探索首个专为公平性设计的在线异步多项迷你面试（MMI）的心理测量学特性，并进行关键特征、可用性和可接受性的亚组分析。
跨学科多方法评估。
英国一所大学。
2021-2022 年护理、助产学和辅助医疗科学本科课程的申请人。
主要、次要结果测量：使用 Cronbach's alpha（α）、平行分析（PA）、Schmid-Leiman 转换和有序验证性因素分析（CFA）评估心理测量学特性（内部一致性、构念效度、维度）。使用描述性统计和常规内容分析评估可用性和可接受性。
系统配置为 7 个问题 4 分钟的 MMI。申请人录制他们的答案，然后由面试官进行评估并汇总分数。申请人和面试官完成在线评估问卷。
712 名申请人的表现数据确定了异步 MMI 的良好至优秀可靠性（平均α为 0.72），且在亚组（性别、年龄、残疾/支持需求、英国/非英国）中具有相似结果。PA 和因子分析结果表明，有七个因素与 MMI 问题相关，有一个潜在的一般因素可以解释观察到的候选者反应的方差。测试七因素层次模型的 CFA 显示数据拟合度极好（验证拟合指数=0.99，Tucker Lewis 指数=0.99，均方根误差（RMSE）=0.034）。申请人（n=210）认为该系统具有灵活性、轻松的环境和节省成本的优势。面试官（n=65）报告说该系统直观、灵活，与面对面访谈相比可节省超过 70%的时间。减少个人沟通被认为是主要缺点。
我们发现异步 MMI 可靠、高效、公平且可接受，且具有成本效益。这些新颖的见解适用于国际上的医疗保健专业人员选拔，为确保未来的在线面试配置能够代表他们所服务的社会提供信息。
