Yoo Dong-Mi, Han Jae-Jin
Department of Medical Education, Ewha Womans University School of Medicine, Seoul, Korea.
Korean J Med Educ. 2013 Jun;25(2):131-7. doi: 10.3946/kjme.2013.25.2.131. Epub 2013 Jun 30.
This study examined the use of the Tucker linear equating method in producing an individual student's score in 3 groups with bridging stations over 3 consecutive days of the clinical performance examination (CPX) and compared the differences in scoring patterns by bridging number.
Data were drawn from 88 examinees from 3 different CPX groups-DAY1, DAY2, and DAY3-each of which comprised of 6 stations. Each group had 3 common stations, and each group had 2 or 3 stations that differed from other groups. DAY1 and DAY3 were equated to DAY2. Equated mean scores and standard deviations were compared with the originals. DAY1 and DAY3 were equated again, and the differences in scores (equated score-raw score) were compared between the 3 sets of equated scores.
By equating to DAY2, DAY1 decreased in mean score from 58.188 to 56.549 and in standard deviation from 4.991 to 5.046, and DAY3 fell in mean score from 58.351 to 58.057 and in standard deviation from 5.546 to 5.856, which demonstrates that the scores of examinees in DAY1 and DAY2 were accentuated after use of the equation. The patterns in score differences between the equated sets to DAY1, DAY2, and DAY3 yielded information on the soundness of the equating results from individual and overall comparisons.
To generate equated scores between 3 groups on 3 consecutive days of the CPX, we applied the Tucker linear equating method. We also present a method of equating reciprocal days to the anchoring day as much as bridging stations.
本研究探讨了塔克线性等值法在临床技能考试(CPX)连续三天的三组带有衔接站的考试中生成个体学生成绩的应用,并比较了按衔接数量划分的评分模式差异。
数据来自88名考生,分为3个不同的CPX组——第一天组、第二天组和第三天组,每组包含6个考站。每组有3个共同考站,每组还有2个或3个与其他组不同的考站。第一天组和第三天组与第二天组进行等值。将等值后的平均分和标准差与原始数据进行比较。第一天组和第三天组再次进行等值,并比较三组等值分数之间的分数差异(等值分数 - 原始分数)。
通过与第二天组等值,第一天组的平均分从58.188降至56.549,标准差从4.991增至5.046;第三天组的平均分从58.351降至58.057,标准差从5.546增至5.856,这表明使用等值法后第一天组和第三天组考生的分数被拉平。与第一天组、第二天组和第三天组等值后的分数差异模式提供了个体和整体比较中等值结果可靠性的信息。
为了在CPX连续三天的三组之间生成等值分数,我们应用了塔克线性等值法。我们还提出了一种将相互对应的日期与锚定日期进行等值的方法,其程度与衔接考站相同。