Leichner P, Sisler G C, Harper D
Can J Psychiatry. 1984 Aug;29(5):394-7. doi: 10.1177/070674378402900506.
A study of the variability between raters in scoring an oral clinical examination in psychiatry in the format of the certification by the Royal College of Physicians and Surgeons of Canada is reported. A video-taped examination from another centre was rated independently by academic psychiatrists, nonacademic psychiatrists and residents. Considerable inter-rater differences between and within these groups were found. In particular, the averaging of the marks of pairs of raters as occurs in the actual certification resulted in the outcome depending to a considerable degree on the chance pairings of raters. These findings support a number of previous studies and emphasize the need to train examiners and to develop clearer rating criteria.
本文报告了一项关于评分者之间在对加拿大皇家内科医师和外科医师学院认证形式的精神病学口腔临床检查进行评分时的变异性研究。来自另一个中心的录像考试由学术精神科医生、非学术精神科医生和住院医生独立评分。在这些组之间和组内发现了相当大的评分者间差异。特别是，实际认证中评分者对的分数平均导致结果在很大程度上取决于评分者的随机配对。这些发现支持了先前的一些研究，并强调了培训考官和制定更清晰评分标准的必要性。
