McCormick W O
Can J Psychiatry. 1981 Jun;26(4):236-39. doi: 10.1177/070674378102600407.
Three videotaped practice clinical, oral examinations were rated by 9, 9 and 11 raters respectively. Raters were all certified specialists engaged in training residents for the certification examinations. In two of the simulated examinations considerable differences in rating scores, to the extent of pass/fail disagreement, were found. The significance of the findings, including the possibility that one examiner may "contaminate" another, is discussed. Further work is essential to develop reliable instruments for rating certification examinations, whatever their format, as the Royal College policies evolve.
三段录像的临床实践口试分别由9名、9名和11名评分者进行评分。评分者均为经过认证的专家，他们参与培训住院医师以准备认证考试。在两次模拟考试中，发现评分分数存在相当大的差异，甚至出现了及格/不及格判定不一致的情况。本文讨论了这些发现的意义，包括一名考官可能会“影响”另一名考官的可能性。随着皇家学院政策的发展，开发可靠的认证考试评分工具至关重要，无论考试形式如何。
