Bhattacherjee Sharmistha, Mukherjee Abhijit, Bhandari Kallol, Rout Arup Jyoti
Department of Community Medicine, North Bengal Medical College, Darjeeling, West Bengal, India.
Indian J Community Med. 2022 Jan-Mar;47(1):92-95. doi: 10.4103/ijcm.ijcm_1156_21. Epub 2022 Mar 16.
Properly constructed single best-answer multiple choice questions (MCQs) or items assess higher-order cognitive processing of Bloom's taxonomy and accurately discriminate between high and low achievers. However, guidelines for writing good test items are rarely followed, leading to generation and application of faulty MCQs.
During lockdown period in 2020, internal assessment was taken through online mode using Google Forms. There were 60 'single response type' MCQs, each consisting of single stem and four options including one correct answer and three distractors. Each item was analyzed for difficulty index (Dif I), discrimination index (DI), and distractor efficiency (DE).
The mean of achieved marks was 42.92± (standard deviation [SD], 5.07). Dif I, DI, and DE were 47.95± (SD 16.39) in percentage, 0.12± (SD 0.10), and 18.42± (SD 15.35), respectively. 46.67% of the items were easy and 21.66% were of acceptable discrimination. Very weak negative correlation was found between Dif I and DI. Out of total 180 distractors, 51.66% were nonfunctional one.
Item analysis and storage of MCQs with their indices provides opportunity for an examiner to select MCQs of appropriate difficulty level as per the need of assessment and decide their placement in the question paper.
精心构建的单项最佳答案选择题(MCQ)或题目能够评估布鲁姆分类法中的高阶认知处理能力,并准确区分成绩高低的学生。然而,编写优质测试题目的指导原则很少被遵循,导致出现有缺陷的MCQ并被应用。
在2020年封锁期间,通过谷歌表单以在线方式进行内部评估。有60道“单项选择题型”的MCQ,每道题由一个题干和四个选项组成,包括一个正确答案和三个干扰项。对每道题进行难度指数(Dif I)、区分指数(DI)和干扰项效率(DE)分析。
所得分数的平均值为42.92±(标准差[SD],5.07)。难度指数、区分指数和干扰项效率分别为47.95±(标准差16.39)(百分比)、0.12±(标准差0.10)和18.42±(标准差15.35)。46.67%的题目容易,21.66%的题目区分度可接受。在难度指数和区分指数之间发现了非常弱的负相关。在总共180个干扰项中,51.66%是无效的。
对MCQ及其指数进行题目分析和存储,为考官提供了根据评估需求选择适当难度水平的MCQ并决定其在试卷中位置的机会。