Postgraduate Medical and Dental Education, NHS West Midlands Workforce Deanery, Birmingham, UK.
Postgrad Med J. 2012 Jan;88(1035):10-4. doi: 10.1136/postgradmedj-2011-130010. Epub 2011 Nov 3.
Multi-source feedback (MSF) has an established role in the workplace based assessment of doctors in training. Different models of MSF are currently used in different training programmes and settings. One important way in which these models differ is the rating scale on which assessors score the trainee. The aim of this study was to explore the effect of rating scale on MSF scores.
Foundation Year 2 trainees in hospitals in the West Midlands underwent MSF using the validated MSF tool, team assessment of behaviour (TAB) in autumn 2005. Trainees were scored with TAB using one of four different rating scales, ranging from 3- to 9-point scales. Each participating hospital used only one rating scale. The proportions of trainees scored as having potential problems were related to the different rating scale used. Similarly, the proportions scored as 'above expectations' were compared. Assessors also completed a short questionnaire regarding the assessment.
245 trainees underwent 2594 assessments. Longer rating scales were associated with a lower proportion of trainees awarded 'problem' scores and higher proportions of trainees scored as 'above expectations'. Assessors generally reported no difficulties whichever rating scale they had used.
Careful consideration, recognising its potential impact on assessment score, should be given to the rating scale used when instituting MSF within a system of workplace based assessment.
多源反馈（MSF）在培训医生的工作场所评估中具有既定作用。不同的 MSF 模型目前在不同的培训计划和环境中使用。这些模型的一个重要区别是评估者对学员进行评分的评分尺度。本研究的目的是探讨评分尺度对 MSF 评分的影响。
2005 年秋季，西米德兰兹医院的第二年住院医师接受了经过验证的 MSF 工具——团队行为评估（TAB）的 MSF 评估。使用 TAB 对学员进行评分，评分尺度从 3 分到 9 分不等。每个参与的医院仅使用一种评分尺度。根据使用的不同评分尺度，将被评为存在潜在问题的学员的比例进行相关比较。同样，将被评为“超出预期”的比例进行比较。评估者还就评估完成了一份简短的问卷。
245 名学员接受了 2594 次评估。评分尺度越长，被评为“存在问题”的学员比例越低，被评为“超出预期”的学员比例越高。评估者报告说，无论使用哪种评分尺度，他们都没有遇到困难。
在实施基于工作场所的评估系统内的 MSF 时，应慎重考虑并认识到所使用的评分尺度可能对评估评分产生的影响。
