Fiedler K M, Beach B L, Hayman J
J Am Diet Assoc. 1981 Feb;78(2):149-53.
Performance evaluation as conducted among a number of raters using several evaluation tools requires the qualities of content validity and interrater reliability to be fair and effective. A procedural model was tested and implemented by faculty and students in the Coordinated Undergraduate Program (CUP) at the University of Tennessee, Knoxville. A checklist for evaluation of employee counseling techniques achieved an intraclass correlation of 0.72 when used by clinical instructors in a series of workshops. The procedure included development of a form, its use in a standardized situation, discussion, calculation of intraclass correlation, and review. The model is suggested for implementation in any program from which established validity and reliability in evaluation are desired.
由多名评估者使用多种评估工具进行的绩效评估,需要具备内容效度和评估者间信度等特质,才能做到公平且有效。田纳西大学诺克斯维尔分校的本科协调项目(CUP)的教师和学生测试并实施了一个程序模型。一份用于评估员工咨询技巧的清单,在一系列研讨班中由临床教师使用时,组内相关系数达到了0.72。该程序包括表单的制定、在标准化情境中的使用、讨论、组内相关系数的计算以及审查。建议在任何希望在评估中建立效度和信度的项目中实施该模型。