Dhanvijay Anup Kumar D, Dhokane Nitin, Balgote Santosh, Kumari Anita, Juhi Ayesha, Mondal Himel, Gupta Pratima
Physiology, All India Institute of Medical Sciences, Deoghar, IND.
Physiology, Government Medical College, Sindhudurg, IND.
Cureus. 2023 Aug 24;15(8):e44049. doi: 10.7759/cureus.44049. eCollection 2023 Aug.
Background Multiple choice questions (MCQs) are commonly used in medical exams for more objectivity in assessment. However, the quality of the questions should be optimum for a proper assessment of the students. A faculty development program (FDP) may improve the quality of MCQs. The effect of a one-day workshop on framing MCQ as a part of a FDP has not been explored in our institution. Aim This study aimed to evaluate the quality of MCQ in the subject of physiology before and after a one-day workshop on framing MCQ as a part of a FDP. Methods This was a retrospective study conducted in the Department of Physiology, All India Institute of Medical Sciences, Deoghar, Jharkhand, India. A one-day workshop on framing MCQ as a part of a FDP was conducted in March 2022. We took 100 MCQs and responses from the students from examinations conducted before the workshop and 100 MCQs and responses from the students after the workshop. In pre-workshop and post-workshop, the same five faculties framed the questions. Post-validation item analysis including difficulty index (DIFI), discrimination index (DI), distractor effectiveness (DE), and Kuder-Richardson Formula 20 (KR-20) for internal consistency was calculated. Results Pre-workshop and post-workshop quality of the MCQ remain equal in terms of DIFI (chi-square {3} = 2.42, P = 0.29), DI (chi-square {3} = 2.44, P = 0.49), and DE (chi-square {3} = 4.97, P = 0.17). The KR-20 in pre-workshop and post-workshop was 0.65 and 0.87, respectively. Both had acceptable internal consistency. Conclusion The one-day workshop on framing MCQs as a part of a FDP did not have a significant impact on the quality of the MCQs as measured by the three indices of item quality but did improve the internal consistency of the MCQs. Further educational programs and research are required to find out what measures can improve the quality of MCQs.
背景 多项选择题（MCQs）常用于医学考试，以提高评估的客观性。然而，问题的质量应达到最佳，以便对学生进行恰当评估。教师发展计划（FDP）可能会提高多项选择题的质量。在我们机构中，尚未探讨将为期一天的关于编写多项选择题的工作坊作为FDP一部分的效果。
目的 本研究旨在评估在将编写多项选择题作为FDP一部分的为期一天的工作坊前后，生理学学科中多项选择题的质量。
方法 这是一项在印度贾坎德邦迪奥加尔全印医学科学研究所生理学系进行的回顾性研究。2022年3月举办了一场将编写多项选择题作为FDP一部分的为期一天的工作坊。我们从工作坊前进行的考试中选取了100道多项选择题及学生的答案，以及工作坊后100道多项选择题及学生的答案。在工作坊前和工作坊后，由相同的五名教师编写问题。计算了包括难度指数（DIFI）、区分指数（DI）、干扰项有效性（DE）以及用于内部一致性的库德 - 理查森公式20（KR - 20）在内的事后验证项目分析。
结果 在DIFI（卡方{3}=2.42，P = 0.29）、DI（卡方{3}=2.44，P = 0.49）和DE（卡方{3}=4.97，P = 0.17）方面，工作坊前和工作坊后多项选择题的质量保持相等。工作坊前和工作坊后的KR - 20分别为0.65和0.87。两者都具有可接受的内部一致性。
结论 将编写多项选择题作为FDP一部分的为期一天的工作坊，根据项目质量的三个指标衡量，对多项选择题的质量没有显著影响，但确实提高了多项选择题的内部一致性。需要进一步的教育计划和研究来找出哪些措施可以提高多项选择题的质量。
