Chauhan Girish R, Chauhan Bhoomika R, Vaza Jayesh V, Chauhan Pradip R
Department of Oral Pathology and Maxillofacial Surgery, Government Dental College, Jamnagar, Jamnagar, IND.
Department of Obstetrics and Gynaecology, Banas Medical College and Research Institute, Palanpur, IND.
Cureus. 2023 Jul 26;15(7):e42492. doi: 10.7759/cureus.42492. eCollection 2023 Jul.
Background Multiple choice questions (MCQ) are used nowadays in summative assessments for certification of courses, in a competitive examination, and for recruitment. A single-best-answer stem-type MCQ is one of the formats most commonly used for this purpose; it contains a question and options from which the examinee needs to select the correct answer. Item analysis is used for the determination of the quality, validity, and reliability of the MCQ. Item difficulty index, item discrimination power, and distractor effectiveness are critical for the quality of the MCQs. Aim This study was conducted to estimate the effect of distractor effectiveness on the item difficulty index and item discriminating power. Method A test paper consisting of 200 single-best-answer stem-type MCQs with four options responded to by 400 medical undergraduates was analyzed for item difficulty index, item discriminating power, and distractor effectiveness with established item analysis formulas. The effect of distractor effectiveness on item difficulty index and item discriminating power was statistically analyzed using Epi-Info 7software. Result The mean item difficulty index, item discriminating power, and distractor effectiveness were 57.75% ± 28.65%, 0.4388 ± 0.36, and 84.17%, respectively (p<0.05). The item difficulty index was higher for items with single-functioning distractors in comparison to items with three-functioning distractors. Item discriminating power was higher in items with three functioning distractors in comparison to items with one and two functioning distractors. Conclusion Two or three functioning distractors show an appropriate item difficulty index and item discriminating power. In addition, item discriminating power is lower for the easy MCQs. Two to three distractors are appropriate to construct a quality MCQ.
背景 多项选择题(MCQ)如今用于课程认证的终结性评估、竞争性考试以及招聘。单项最佳答案题干型多项选择题是最常用于此目的的格式之一;它包含一个问题以及考生需要从中选择正确答案的选项。项目分析用于确定多项选择题的质量、有效性和可靠性。项目难度指数、项目区分度和干扰项有效性对于多项选择题的质量至关重要。目的 本研究旨在评估干扰项有效性对项目难度指数和项目区分度的影响。方法 对一份由200道单项最佳答案题干型多项选择题组成的试卷进行分析,该试卷有四个选项,由400名医科本科生作答,使用既定的项目分析公式计算项目难度指数、项目区分度和干扰项有效性。使用Epi-Info 7软件对干扰项有效性对项目难度指数和项目区分度的影响进行统计分析。结果 平均项目难度指数、项目区分度和干扰项有效性分别为57.75% ± 28.65%、0.4388 ± 0.36和84.17%(p<0.05)。与具有三种功能干扰项的题目相比,具有单一功能干扰项的题目的项目难度指数更高。与具有一种和两种功能干扰项的题目相比,具有三种功能干扰项的题目的项目区分度更高。结论 具有两种或三种功能的干扰项显示出合适的项目难度指数和项目区分度。此外,简单多项选择题的项目区分度较低。两到三个干扰项适合构建高质量的多项选择题。