Ostrow School of Dentistry, DEN 218, University of Southern California, 925 W. 34 Street, Los Angeles, CA 90089-0641;.
J Dent Educ. 2013 Oct;77(10):1315-20.
The triple jump examination (TJE) attempts to assess a higher level of learning with demand for analysis, critical thinking, and resolution of problems presented by written scenarios based on patient care situations. The purpose of this study was to examine the internal consistency, scale reliability, and interrater reliability of the TJE used at the Ostrow School of Dentistry, University of Southern California. On the sample of 2,227 examinations administered by seventy-seven raters across a three-year time period, the Cronbach's coefficient alpha for internal consistency of the overall TJE was found to be good (a=0.869). The internal consistency of the three subscales was found to be acceptable (a=0.731), good (a=0.820), and good (a=0.820). Average and single measures intraclass correlation coefficients (ICC) for scale reliability were significant at p<0.001, indicating strong interrater reliability. There were no statistically significant differences (p≤0.05) in the mean scores assigned on the TJE between rater groups defined by rater experience level with the TJE. A very high level of agreement among rater pairs was also observed. Across the entire three-year study period, with over 19,152 ratings, the seventy-seven raters were in general agreement 99.5 percent of the time and in exact agreement 77.2 percent of the time.
三级跳远考试（TJE）试图评估更高层次的学习，要求考生根据患者护理情况的书面情景分析、批判性思维和解决问题。本研究的目的是检验南加州大学奥斯特罗牙科学校使用的 TJE 的内部一致性、量表信度和评分者间信度。在 77 名评分者在三年时间内进行的 2227 次考试样本中，整体 TJE 的克朗巴赫系数阿尔法的内部一致性被发现是良好的（a=0.869）。三个分量表的内部一致性被发现是可接受的（a=0.731）、良好的（a=0.820）和良好的（a=0.820）。量表可靠性的平均和单一度量组内相关系数（ICC）在 p<0.001 时具有统计学意义，表明评分者间具有很强的信度。在 TJE 评分者经验水平定义的评分者组之间，TJE 的平均分数分配没有统计学上的显著差异（p≤0.05）。评分者对之间也观察到非常高的一致性。在整个三年的研究期间，有超过 19152 次评分，77 名评分者总体上有 99.5%的时间达成一致，有 77.2%的时间达成完全一致。
