Suppr超能文献

加纳一所大学学生教学评价中的项目和评分者差异:多面Rasch模型的应用

Item and rater variabilities in students' evaluation of teaching in a university in Ghana: application of Many-Facet Rasch Model.

作者信息

Quansah Frank

机构信息

Department of Educational Foundations, University of Education, Winneba, Ghana.

出版信息

Heliyon. 2022 Dec 21;8(12):e12548. doi: 10.1016/j.heliyon.2022.e12548. eCollection 2022 Dec.

Abstract

This research examined the item and rater variabilities in students' evaluation of teaching and courses exercise at the University of Cape Coast (UCC) through the lenses of the Many-Facet Rasch Model (MFRM). The study covered students during the 2019/2020 academic year in the selected university, analysing secondary data obtained from the Directorate of Academic Planning and Quality Assurance, UCC (DAPQA-UCC). The data were analysed by conducting partial credit MFRM analyses. It was found that the sources of measurement errors in the student evaluation exercise included halo effect, non-functional item structure, inconsistent students' ratings, rater leniency, and non-functional rating scale. It was concluded that data from students' appraisal of lecturers' teaching should be used with caution. It was recommended that DAPQA-UCC and the university management should train students on the evaluation of teaching, as well as review the existing evaluation form for appraising courses and teaching by subjecting the instrument to rigorous validation procedures.

摘要

本研究通过多面Rasch模型(MFRM)的视角,考察了开普海岸大学(UCC)学生对教学和课程练习评价中的项目及评分者变异性。该研究涵盖了所选大学2019/2020学年的学生,分析了从UCC学术规划与质量保证局(DAPQA-UCC)获得的二手数据。通过进行部分计分MFRM分析对数据进行了分析。结果发现,学生评价练习中的测量误差来源包括光环效应、非功能性项目结构、学生评分不一致、评分者宽松以及非功能性评分量表。研究得出结论,学生对教师教学评价的数据应谨慎使用。建议DAPQA-UCC和大学管理层对学生进行教学评价培训,并通过对现有评价表进行严格验证程序,来审查用于评价课程和教学的现有评价表。

相似文献

1
Item and rater variabilities in students' evaluation of teaching in a university in Ghana: application of Many-Facet Rasch Model.
Heliyon. 2022 Dec 21;8(12):e12548. doi: 10.1016/j.heliyon.2022.e12548. eCollection 2022 Dec.
4
Investigating rater-student interaction, gender bias, and major bias in the assessment of research seminar presentation.
Heliyon. 2023 May 23;9(6):e16548. doi: 10.1016/j.heliyon.2023.e16548. eCollection 2023 Jun.
5
An Investigation of First-Year Students' and Lecturers' Expectations of University Education.
Front Psychol. 2018 Jan 26;8:2218. doi: 10.3389/fpsyg.2017.02218. eCollection 2017.
6
Unmasking the coronavirus pandemic impact on students' academic performance (University of Cape Coast-Ghana).
PLOS Glob Public Health. 2024 Jul 16;4(7):e0003409. doi: 10.1371/journal.pgph.0003409. eCollection 2024.
7
A Bayesian many-facet Rasch model with Markov modeling for rater severity drift.
Behav Res Methods. 2023 Oct;55(7):3910-3928. doi: 10.3758/s13428-022-01997-z. Epub 2022 Oct 25.
9
University students' perspectives on the benefits and challenges of emergency remote teaching during the Covid-19 pandemic in Ghana.
Educ Inf Technol (Dordr). 2023;28(5):6093-6113. doi: 10.1007/s10639-022-11401-0. Epub 2022 Nov 9.
10
Physiotherapy students' rating on lecturers' and supervisors' clinical education attributes.
Hong Kong Physiother J. 2024 Dec;44(2):79-90. doi: 10.1142/S1013702524500045. Epub 2023 Oct 5.

引用本文的文献

1
Modeling unit non-response and validity of online teaching evaluation in higher education using generalizability theory approach.
Front Psychol. 2023 Sep 4;14:1202896. doi: 10.3389/fpsyg.2023.1202896. eCollection 2023.
2
Effective teaching in computational thinking: A bias-free alternative to the exclusive use of students' evaluations of teaching (SETs).
Heliyon. 2023 Aug 10;9(8):e18997. doi: 10.1016/j.heliyon.2023.e18997. eCollection 2023 Aug.

本文引用的文献

1
A Multivariate Generalizability Theory Approach to College Students' Evaluation of Teaching.
Front Psychol. 2018 Jun 26;9:1065. doi: 10.3389/fpsyg.2018.01065. eCollection 2018.
2
How Do We Know What Works? A Review and Critique of Current Practices in Ethics Training Evaluation.
Account Res. 2016;23(6):319-50. doi: 10.1080/08989621.2016.1186547.
3
Is It All Relative? Comparative Judgments and the Possible Improvement of Self-Ratings and Ratings of Others.
Perspect Psychol Sci. 2011 Jan;6(1):48-60. doi: 10.1177/1745691610393521. Epub 2011 Feb 3.
4
Properties of Rasch residual fit statistics.
J Appl Meas. 2013;14(4):339-55.
5
Construction of measures from many-facet data.
J Appl Meas. 2002;3(4):486-512.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验