Quansah Frank
Department of Educational Foundations, University of Education, Winneba, Ghana.
Heliyon. 2022 Dec 21;8(12):e12548. doi: 10.1016/j.heliyon.2022.e12548. eCollection 2022 Dec.
This research examined the item and rater variabilities in students' evaluation of teaching and courses exercise at the University of Cape Coast (UCC) through the lenses of the Many-Facet Rasch Model (MFRM). The study covered students during the 2019/2020 academic year in the selected university, analysing secondary data obtained from the Directorate of Academic Planning and Quality Assurance, UCC (DAPQA-UCC). The data were analysed by conducting partial credit MFRM analyses. It was found that the sources of measurement errors in the student evaluation exercise included halo effect, non-functional item structure, inconsistent students' ratings, rater leniency, and non-functional rating scale. It was concluded that data from students' appraisal of lecturers' teaching should be used with caution. It was recommended that DAPQA-UCC and the university management should train students on the evaluation of teaching, as well as review the existing evaluation form for appraising courses and teaching by subjecting the instrument to rigorous validation procedures.
本研究通过多面Rasch模型(MFRM)的视角,考察了开普海岸大学(UCC)学生对教学和课程练习评价中的项目及评分者变异性。该研究涵盖了所选大学2019/2020学年的学生,分析了从UCC学术规划与质量保证局(DAPQA-UCC)获得的二手数据。通过进行部分计分MFRM分析对数据进行了分析。结果发现,学生评价练习中的测量误差来源包括光环效应、非功能性项目结构、学生评分不一致、评分者宽松以及非功能性评分量表。研究得出结论,学生对教师教学评价的数据应谨慎使用。建议DAPQA-UCC和大学管理层对学生进行教学评价培训,并通过对现有评价表进行严格验证程序,来审查用于评价课程和教学的现有评价表。