Dimitrov Dimiter M
George Mason University, Fairfax, VA, USA.
National Center for Assessment, Riyadh, Saudi Arabia.
Educ Psychol Meas. 2022 Aug;82(4):719-746. doi: 10.1177/00131644211032388. Epub 2021 Jul 21.
Proposed is a new method of standard setting referred to as response vector for mastery (RVM) method. Under the RVM method, the task of panelists that participate in the standard setting process does not involve conceptualization of a borderline examinee and probability judgments as it is the case with the Angoff and bookmark methods. Also, the RVM-based computation of a cut-score is not based on a single item (e.g., marked in an ordered item booklet) but, instead, on a response vector (1/0 scores) on items and their parameters calibrated in item response theory or under the recently developed -scoring method. Illustrations with hypothetical and real-data scenarios of standard setting are provided and methodological aspects of the RVM method are discussed.
提出了一种新的标准设定方法,称为掌握响应向量(RVM)法。在RVM方法下,参与标准设定过程的专家小组成员的任务不像安格夫法和书签法那样涉及界定边缘考生的概念和概率判断。此外,基于RVM的及格分数计算不是基于单个项目(例如,在有序项目手册中标记的项目),而是基于项目的响应向量(1/0分数)及其在项目反应理论或最近开发的-评分方法下校准的参数。文中提供了标准设定的假设和实际数据场景示例,并讨论了RVM方法的方法学方面。