Pitts John, Coles Colin, Thomas Peter, Smith Frank
NHS Executive South East Region (Wessex Deanery) Winchester, King Alfred's College Winchester, UK.
Med Teach. 2002 Mar;24(2):197-201. doi: 10.1080/01421590220125321.
This paper reports the reliability in assessments of a series of portfolios assembled by a cohort of participants attending a course for prospective general practice trainers. Initial individual assessments are compared with open discussion between random pairs of assessors to produce paired composite scores, and analysed using kappa statistics. Overall reliability of a global pass/refer judgement improved from a kappa of 0.26 (fair) using individual assessment, to 0.5 (moderate) with paired discussants.
本文报告了一组参加全科医生培训课程的学员所组建的一系列档案袋评估的可靠性。将最初的个人评估与评估者随机配对进行的公开讨论结果相比较，得出配对综合分数，并使用kappa统计量进行分析。整体及格/参考判断的可靠性从个人评估时的kappa值0.26（一般）提高到配对讨论者时的0.5（中等）。
