Kulshreshtha Shabdika, Gupta Ganesh, Goyal Gourav, Gupta Kalika, Davda Kush
Department of Obstetrics and Gynaecology, Geetanjali Medical College and Hospital, Udaipur, Rajasthan India.
Department of Anaesthesiology, Pacific Medical College and Hospital, Bhilo Ka Bedla, Udaipur, Rajasthan India.
J Obstet Gynaecol India. 2024 Jun;74(3):256-264. doi: 10.1007/s13224-023-01904-2. Epub 2024 Feb 20.
MCQs (multiple choice questions) can be used to assess higher-order skills and be utilised for creating a question bank.
To perform post-validation item analysis of MCQs constructed by medical faculty for formative assessment of final-year medical students and to explore the association between difficulty index ( value) and discrimination indices (DI) with distractor efficiency (DE).
An observational study was conducted involving 50 final-year MBBS students and 10 faculty members for a period of one year (October 2020 to September 2021). After training the faculty in item analysis, a MCQ test was prepared after collecting the peer-reviewed 25 MCQs (five each from various subtopics of the subject). The result of this test was used to calculate the FV (facility value), DI (discrimination index), and DE (distractor efficiency) of each item. Student and faculty feedback was also obtained on a five-point Likert scale.
The mean FV was 46.3 ± 19.3 and 64% of questions were difficult; the mean DI was 0.3 ± 0.1 and 92% of questions could differentiate between HAG (high achiever's group) and LAG (low achiever's group); the mean DE was 82% ± 19.8 and 48% of items had no NFDs (non-functional distractors).
MCQs can be used to assess all the levels of Bloom's taxonomy. Item analysis yielded 23 out of 25 MCQs that were suitable for the question bank.
多项选择题(MCQs)可用于评估高阶技能,并用于创建题库。
对医学教师为医学专业最后一年学生的形成性评估所构建的多项选择题进行效度验证后的项目分析,并探讨难度指数(值)和区分指数(DI)与干扰项效率(DE)之间的关联。
进行了一项观察性研究,涉及50名医学专业最后一年的学生和10名教师,为期一年(2020年10月至2021年9月)。在对教师进行项目分析培训后,收集经过同行评审的25道多项选择题(该学科各子主题各5道)后编制了一份多项选择题测试。该测试结果用于计算每个项目的FV(难易度值)、DI(区分指数)和DE(干扰项效率)。还通过五点李克特量表获得了学生和教师的反馈。
平均FV为46.3±19.3,64%的问题较难;平均DI为0.3±0.1,92%的问题能够区分高分组(HAG)和低分组(LAG);平均DE为82%±19.8,48%的项目没有无功能干扰项(NFDs)。
多项选择题可用于评估布鲁姆分类法的所有层次。项目分析得出25道多项选择题中有23道适合纳入题库。