Hajj Hussein Inaya, Braithwaite Collin, Uhley Virginia, Mohiyeddini Changiz
Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Oakland University, Rochester, MI, USA.
J CME. 2024 May 16;13(1):2352964. doi: 10.1080/28338073.2024.2352964. eCollection 2024.
Examinations are essential in assessing student learning in medical education. Ensuring the quality of exam questions is a highly challenging yet necessary task to assure that assessments are equitable, reliable, and aptly gauge student learning. The aim of this study was to investigate whether the incorporation of student feedback can enhance the quality of exam questions in the Renal and Urinary System course, offered to second-year medical students. Using a single-arm between-person survey-based design, we conducted an a priori power analysis to establish the sample size. The exam comprised 100 multiple-choice questions written by a panel of 31 instructors. A total of 125 medical students took the exam in 2021. Following the exam, student feedback was collected, resulting in the revision of 12 questions by two subject experts. In the following year, the revised questions were administered to a new cohort of 125 second-year medical students. We used Fisher's z-transformation to test the significance of differences in point-biserial correlations between the 2021 and 2022 cohorts. The results reveal that 66% of the revised exam questions exhibited significantly higher point-biserial correlations. This demonstrates the positive impact of involving students in the exam revision process. Their feedback enhances question clarity, relevance, alignment with learning objectives, and overall quality. In conclusion, student participation in exam evaluation and revision can improve the quality of exam questions. This approach capitalises on students experiences and feedback and complements the traditional approaches to ensure the quality of exam questions, benefiting both the institution and its learners.
考试对于评估医学教育中的学生学习情况至关重要。确保考试问题的质量是一项极具挑战性但又必要的任务,以保证评估的公平性、可靠性,并恰当地衡量学生的学习情况。本研究的目的是调查纳入学生反馈是否能提高面向二年级医学生开设的肾脏和泌尿系统课程的考试问题质量。我们采用基于单臂组内调查的设计,进行了一项预先的功效分析以确定样本量。该考试由31名教师组成的小组编写的100道多项选择题组成。2021年共有125名医学生参加了考试。考试结束后,收集了学生反馈,两名学科专家据此对12道题进行了修订。在接下来的一年里,将修订后的题目施测于新的125名二年级医学生群体。我们使用费舍尔z变换来检验2021年和2022年群体之间点二列相关差异的显著性。结果显示,66%的修订后的考试题目表现出显著更高的点二列相关性。这证明了让学生参与考试修订过程的积极影响。他们的反馈提高了问题的清晰度、相关性、与学习目标的一致性以及整体质量。总之,学生参与考试评估和修订可以提高考试问题的质量。这种方法利用了学生的经验和反馈,补充了传统方法以确保考试问题的质量,使机构及其学习者都受益。