Schubert Sebastian, Schnabel Kai P, Winkelmann Andreas
Assessment Division and Reformed Medical Curriculum, Working Group, Deanery of Student Affairs, Charité Universitatsmedizin Berlin, Berlin, Germany.
Med Teach. 2009 Jan;31(1):e13-7. doi: 10.1080/01421590802334325.
Text only multiple choice questions (MCQs) are often inadequate to assess anatomical and histological knowledge and may encourage students to memorize abstract textbook knowledge. An alternative are the "spotters" or "tag tests" well-known in North American and British anatomy. However, the psychometric properties of this assessment have only been reported in one study for a format using short answer questions.
To describe the implementation and feasibility of a multiple choice "tag test" (3D-MC) using prosected specimens, histological slides, models and radiographs; to report the psychometric properties and students' acceptance of the 3D-MC; to compare it with a traditional multiple choice format.
The administration of the 3D-MC did not pose any major problems. The 3D-MC was significantly easier (mean scores 75% vs. 64%) than traditional MCQs. The estimated correlation (corrected for attenuation) between the two MCQ formats was r = 0.814. Reliability for the 3D-MC was. 665 for 30 items. Student acceptance was very high.
The 3D-MC is a feasible, reliable and well-accepted test of anatomical knowledge. Further research should investigate if the higher cost as compared to MCQs using photographs is justified by the assessment of different knowledge and abilities as compared to MCQs using photographs.
仅包含文字的多项选择题(MCQs)往往不足以评估解剖学和组织学知识,还可能促使学生死记硬背抽象的教科书知识。另一种方式是北美和英国解剖学中广为人知的“识别测试”或“标记测试”。然而,这种评估方式的心理测量特性仅在一项关于使用简答题形式的研究中有过报道。
描述使用解剖标本、组织学切片、模型和X光片的多项选择“标记测试”(3D - MC)的实施情况和可行性;报告3D - MC的心理测量特性及学生对其的接受程度;并将其与传统多项选择形式进行比较。
3D - MC的实施未出现任何重大问题。3D - MC明显比传统多项选择题更容易(平均得分75%对64%)。两种多项选择题形式之间的估计相关性(经衰减校正)为r = 0.814。30道题的3D - MC的信度为0.665。学生的接受度非常高。
3D - MC是一种可行、可靠且被广泛接受的解剖学知识测试。进一步的研究应调查与使用照片的多项选择题相比,3D - MC因评估不同的知识和能力而导致的较高成本是否合理。