Department of Philosophy, Sociology, Education and Applied Psychology (FISPPA), University of Padova, Padova, Italy.
Department of Psychology, University of Tübingen, Tuebingen, Germany.
Br J Math Stat Psychol. 2024 Nov;77(3):429-458. doi: 10.1111/bmsp.12335. Epub 2024 Feb 2.
Competence-based test development is a recent and innovative method for the construction of tests that are as informative as possible about the competence state (the set of skills an individual has available) underlying the observed item responses. It finds application in different contexts, including the development of tests from scratch, and the improvement or shortening of existing tests. Given a fixed collection of competence states existing in a population of individuals and a fixed collection of competencies (each of which being the subset of skills that allow for solving an item), the competency deletion procedure results in tests that differ from each other in the competencies but are all equally informative about individuals' competence states. This work introduces a streamlined version of the competency deletion procedure that considers information necessary for test construction only, illustrates a straightforward way to incorporate test developer preferences about competencies into the test construction process, and evaluates the performance of the resulting tests in uncovering the competence states from the observed item responses.
基于能力的测试开发是一种最近出现的创新方法，用于构建尽可能多地反映观察到的项目反应背后的能力状态（个体拥有的技能集合）的测试。它在不同的情境中都有应用，包括从头开始开发测试，以及改进或缩短现有的测试。给定一个固定的个体群体中的能力状态集合和一个固定的能力集合（每个能力都是允许解决一个项目的技能子集），能力删除过程会导致不同的测试在能力上有所不同，但在个体能力状态方面都具有相同的信息量。本工作引入了一种简化版的能力删除过程，仅考虑测试构建所需的信息，说明了一种直接的方法，将测试开发者对能力的偏好纳入测试构建过程，并评估了由此产生的测试在从观察到的项目反应中揭示能力状态的性能。
