University of Rhode Island, College of Pharmacy, Department of Pharmacy Practice, 7 Greenhouse Road, Kingston, RI 02881, United States.
University of Rhode Island, College of Pharmacy, Department of Pharmacy Practice, 7 Greenhouse Road, Kingston, RI 02881, United States.
Curr Pharm Teach Learn. 2020 May;12(5):539-543. doi: 10.1016/j.cptl.2020.01.018. Epub 2020 Jan 31.
The decision to disable item review, or 'backward navigation,' during computerized-fixed item tests proved controversial among faculty at our institution. We sought to determine the effect of disabling backward navigation on performance of individual exam items and overall exam performance across multiple courses within a doctor of pharmacy program.
Exam items that were administered unchanged and without error or adjustment of scoring between 2016 and 2017 were eligible for inclusion. Included items were evaluated for change in difficulty index, point biserial, and discrimination index for the year when backward navigation was enabled to the year after the function was disabled. Performance on matching exam pairs in each time frame was compared for any changes.
We screened 2033 items and identified 576 which met study inclusion criteria. There were no significant differences in overall item difficulty index, point biserial, discrimination index or performance of the 27% lowest-scoring students. There was a decrease of 0.95% for the highest-scoring students (z = -2.93, p = 0.003). We identified 15 pairs of exams that contained at least 30% identical items from 2016 to 2017. No difference was found in the percent score minimum, maximum, mean, median, or standard deviation.
Although there was a statistically significant decrease in item performance for students with the highest scores on the exam, we were unable to demonstrate that disabling backward navigation had a significant impact on overall item performance or exam results.
在计算机化固定项目测试中，禁用项目回顾或“后退导航”的决定在我们机构的教师中引起了争议。我们旨在确定在多个药学博士课程中，禁用后退导航对个别考试项目的表现以及整体考试表现的影响。
在 2016 年至 2017 年期间，未进行更改、无错误或评分调整的考试项目符合纳入标准。评估了在启用后退导航的那一年与禁用该功能的那一年之间，难度指数、二分位点和辨别指数的变化。比较了每个时间框架中配对考试的表现，以确定是否有任何变化。
我们筛选了 2033 个项目，确定了 576 个符合研究纳入标准的项目。整体项目难度指数、二分位点、辨别指数或得分最低的 27%学生的表现均无显著差异。得分最高的学生的表现下降了 0.95%（z=-2.93，p=0.003）。我们确定了 2016 年至 2017 年期间包含至少 30%相同项目的 15 对考试。在最低分、最高分、平均分、中位数或标准差方面，没有差异。
尽管得分最高的学生的项目表现存在统计学上的显著下降，但我们无法证明禁用后退导航对整体项目表现或考试结果有重大影响。
