Hecker Kent, Read Emma K, Vallevand Andrea, Krebs Gord, Donszelmann Darlene, Muelling Christoph K W, Freeman Sarah L
Department of Veterinary, Clinical and Diagnostic Science, University of Calgary, Calgary, Canada.
J Vet Med Educ. 2010 Winter;37(4):395-402. doi: 10.3138/jvme.37.4.395.
The DVM program at the University of Calgary offers a Clinical Skills course each year for the first three years. The course is designed to teach students the procedural skills required for entry-level general veterinary practice. Objective Structured Clinical Examinations (OSCEs) were used to assess students' performance on these procedural skills. A series of three OSCEs were developed for the first year. Content was determined by an exam blueprint, exam scoring sheets were created, rater training was provided, a mock OSCE was performed with faculty and staff, and the criterion-referencing Ebel method was used to set cut scores for each station using two content experts. Each station and the overall exam were graded as pass or fail. Thirty first-year DVM students were assessed. Content validity was ensured by the exam blueprint and expert review. Reliability (coefficient α) of the stations from the three OSCE exams ranged from 0.0 to 0.71. The three exam reliabilities (Generalizability Theory) were, for OSCE 1, G=0.56; OSCE 2, G=0.37; and OSCE 3, G=0.32. Preliminary analysis has suggested that the OSCEs demonstrate face and content validity, and certain stations demonstrated adequate reliability. Overall exam reliability was low, which reflects issues with first-time exam delivery. Because this year was the first that this course was taught and this exam format was used, work continues in the program on the teaching of the procedural skills and the development and revision of OSCE stations and scoring checklists.
卡尔加里大学的兽医学博士课程在头三年每年都会开设一门临床技能课程。该课程旨在教授学生入门级一般兽医实践所需的程序技能。客观结构化临床考试（OSCE）用于评估学生在这些程序技能方面的表现。为第一年开发了一系列三场OSCE考试。考试内容由考试蓝图确定，创建了考试评分表，提供了评分员培训，与教师和工作人员进行了模拟OSCE，并使用两名内容专家采用标准参照的埃贝尔方法为每个考站设定及格分数。每个考站和整个考试都评定为及格或不及格。对30名一年级兽医学博士学生进行了评估。通过考试蓝图和专家评审确保了内容效度。三场OSCE考试各考站的信度（α系数）在0.0至0.71之间。三场考试的信度（概化理论）分别为：OSCE 1，G = 0.56；OSCE 2，G = 0.37；OSCE 3，G = 0.32。初步分析表明，OSCE考试具有表面效度和内容效度，某些考站具有足够的信度。整体考试信度较低，这反映了首次考试实施中存在的问题。由于今年是该课程首次授课且采用了这种考试形式，该项目在程序技能教学以及OSCE考站和评分清单的开发与修订方面仍在继续努力。
