Acad Med. 2009 Oct;84(10 Suppl):S9-12. doi: 10.1097/ACM.0b013e3181b3705a.
Most medical school candidates are excluded without benefit of noncognitive skills assessment. Is development of a noncognitive preinterview screening test that correlates with the well-validated Multiple Mini-Interview (MMI) possible?
Study 1: 110 medical school candidates completed MMI and Computer-based Multiple Sample Evaluation of Noncognitive Skills (CMSENS)-eight 1-minute video-based scenarios and four self-descriptive questions, with short-answer-response format. Seventy-eight responses were audiotaped, 32 typewritten; all were scored by two independent raters. Study 2: 167 candidates completed CMSENS-eight videos, six self-descriptive questions, typewritten responses only, scored by two raters; 88 of 167 underwent the MMI.
Results for overall test generalizability, interrater reliability, and correlation with MMI, respectively, were, for Study 1, audio-responders: 0.86, 0.82, 0.15; typewritten-responders: 0.72, 0.81, 0.51; and for Study 2, 0.83, 0.95, 0.46 (correlation with disattenuation was 0.60).
Strong psychometric properties, including MMI correlation, of CMSENS warrant investigation into future widespread implementation as a preinterview noncognitive screening test.
大多数医学院申请者在没有非认知技能评估的情况下被淘汰。是否有可能开发一种与经过充分验证的多项迷你面试(MMI)相关的非认知预面试筛选测试?
研究 1:110 名医学院申请者完成了 MMI 和基于计算机的多项非认知技能综合评估(CMSENS)-八个 1 分钟的视频情景和四个自我描述问题,采用简短回答格式。78 个答案被录音,32 个打字;所有答案均由两名独立评分人评分。研究 2:167 名申请者完成了 CMSENS-八个视频,六个自我描述问题,仅打字回答,由两名评分人评分;167 名申请者中的 88 名参加了 MMI。
分别针对总体测试可推广性、评分者间可靠性和与 MMI 的相关性,结果为,对于研究 1,音频应答者:0.86、0.82、0.15;书面应答者:0.72、0.81、0.51;对于研究 2,0.83、0.95、0.46(与去偏相关系数为 0.60)。
CMSENS 具有强大的心理测量学特性,包括与 MMI 的相关性,值得进一步研究,以广泛实施作为预面试的非认知筛选测试。