Faculty of Veterinary Medicine, University of Calgary, Calgary, Alberta, Canada.
Teach Learn Med. 2012;24(2):168-76. doi: 10.1080/10401334.2012.664988.
The purpose of this study was to investigate the predictive and construct validity of a high-stakes objective structured clinical examination (OSCE) used to select candidates for a 3-month clinical rotation to assess practice-readiness status.
Analyses were undertaken to establish the reliability and validity of the OSCE. The generalizability coefficient (Ep(2)) for the assessment scores (checklist, global, and total) were all high, ranging from 0.73 to 0.84. Two discriminant analyses (promotion to the 3-month rotation and pass/fail status on the rotation) provided evidence of predictive validity with a 100% correct classification rate in the pass/fail rotation results. Factor analysis results provided evidence of construct validity with four factors identified: Clinical Skills, Internal Medicine, General Medical Knowledge, and Counseling. The known group differences between licensing status and residency experience also provided evidence of construct validity.
The results are encouraging for the predictive and construct validity of the OSCE as an assessment of clinical competence.
本研究旨在探讨一项高风险客观结构化临床考试（OSCE）在选拔参加为期 3 个月临床轮转以评估实践准备状态的候选人方面的预测和结构效度。
对 OSCE 的可靠性和有效性进行了分析。评估分数（检查表、总体和总分）的概化系数（Ep（2））均较高，范围从 0.73 到 0.84。两项判别分析（晋升至 3 个月的轮转和轮转中的通过/失败状态）提供了预测有效性的证据，在轮转的通过/失败结果中具有 100%的正确分类率。因子分析结果提供了结构有效性的证据，确定了四个因素：临床技能、内科、一般医学知识和咨询。执照状态和住院医师经验之间的已知组间差异也提供了结构有效性的证据。
这些结果令人鼓舞，表明 OSCE 作为临床能力评估具有预测和结构效度。
