Himelfarb Igor, Shotts Bruce L, Tang Nai-En, Smith Margaret
J Chiropr Educ. 2020 Mar;34(1):35-42. doi: 10.7899/JCE-18-27. Epub 2019 Jul 8.
The National Board of Chiropractic Examiners (NBCE) uses a robust system for data analysis. The aim of this work is to introduce the reader to the process of score production and the quantitative methods used by the psychometrician and data analysts of the NBCE.
The NBCE employs data validation, diagnostic analyses, and item response theory-based modeling of responses to estimate test takers' abilities and item-related parameters. For this article, the authors generated 1303 synthetic item responses to 20 multiple-choice items with 4 response options to each item. These data were used to illustrate and explain the processes of data validation, diagnostic item analysis, and item calibration based on item response theory.
The diagnostic item analysis is presented for items 1 and 5 of the data set. The 3-parameter logistic item response theory model was used for calibration. Numerical and graphical results are presented and discussed.
Demands for data-driven decision making and evidence-based effectiveness create a need for objective measures to be used in educational program reviews and evaluations. Standardized test scores are often included in that array of objective measures. With this article, we offer transparency of score production used for NBCE testing.
美国国家脊椎按摩疗法考试委员会(NBCE)采用了一套强大的数据分析系统。本文旨在向读者介绍分数生成过程以及NBCE的心理测量师和数据分析师所使用的定量方法。
NBCE采用数据验证、诊断分析以及基于项目反应理论的反应建模来估计考生的能力和与项目相关的参数。在本文中,作者针对20个多项选择题生成了1303个模拟项目反应,每个项目有4个反应选项。这些数据用于说明和解释数据验证、诊断性项目分析以及基于项目反应理论的项目校准过程。
给出了数据集中第1项和第5项的诊断性项目分析。使用三参数逻辑斯蒂项目反应理论模型进行校准。展示并讨论了数值和图形结果。
对数据驱动决策和循证有效性的需求使得在教育项目审查和评估中需要使用客观的测量方法。标准化考试分数通常包含在该系列客观测量方法中。通过本文,我们提供了NBCE测试中分数生成的透明度。