Richter Robin, Tipold Andrea, Schaper Elisabeth
Centre for E-Learning, Didactics and Educational Research, University of Veterinary Medicine Hannover, Bünteweg 2, 30559 Hannover, Germany.
Department of Small Animal Medicine and Surgery, University of Veterinary Medicine Hannover, Bünteweg 9, 30559 Hannover, Germany.
J Vet Med Educ. 2024 Dec;51(6):762-776. doi: 10.3138/jvme-2023-0061. Epub 2023 Nov 28.
Since 2008, electronic examinations have been conducted at the University of Veterinary Medicine Hannover, Germany which are analyzed extensively in the current study. The aim is to assess the quality of examinations, the status quo of the electronic examination system and the implementation of recommendations regarding the conduct of exams at the TiHo. Based on the results suitable indicators for the evaluation of examinations and items as well as adequate quality assurance measures and item formats are to be identified. For this purpose, 294 electronic examinations carried out from 2008 to 2022 of the veterinary medicine course with an average of 248 participants each were evaluated with regard to the quality criteria reliability, difficulty index, and discrimination index. The main finding was that the number of items and the proportion of reused questions were identified as factors through which the quality of the examinations can be increased with simple adjustments. A higher number of items led to better reliability, whereby the required minimum reliability in examinations of 0.8 was reliably achieved from an item number of 98 questions. The proportion of reused questions should be kept low, as these had a negative influence on the characteristic values. Measures accompanying examinations, such as training of question authors and a pre- and post-review process, should also ensure the quality of examinations. For the post-review process, the distribution of examination results, reliability, item and distractor analysis are adequate indicators for evaluating examinations.
自2008年以来，德国汉诺威兽医学院一直在进行电子考试，本研究对这些考试进行了广泛分析。目的是评估考试质量、电子考试系统的现状以及在汉诺威兽医学院实施考试相关建议的情况。基于这些结果，要确定用于评估考试和试题的合适指标，以及适当的质量保证措施和试题形式。为此，对2008年至2022年期间进行的294场兽医学课程电子考试进行了评估，每场考试平均有248名参与者，评估内容包括质量标准可靠性、难度指数和区分指数。主要发现是，试题数量和重复使用问题的比例被确定为通过简单调整就能提高考试质量的因素。试题数量越多，可靠性越高，从98道题目的试题数量开始就能可靠地达到考试所需的最低可靠性0.8。重复使用问题的比例应保持较低水平，因为这些问题会对特征值产生负面影响。考试的配套措施，如对出题者的培训以及考前和考后审查过程，也应确保考试质量。对于考后审查过程，考试结果的分布、可靠性、试题和干扰项分析是评估考试的适当指标。
