Alfers Tobias, Gittler Georg, Ulitzsch Esther, Pohl Steffi
Freie Universität Berlin, Germany.
University of Vienna, Austria.
Educ Psychol Meas. 2024 Oct 7:00131644241271309. doi: 10.1177/00131644241271309.
The speed-accuracy tradeoff (SAT), where increased response speed often leads to decreased accuracy, is well established in experimental psychology. However, its implications for psychological assessments, especially in high-stakes settings, remain less understood. This study presents an experimental approach to investigate the SAT within a high-stakes spatial ability assessment. By manipulating instructions in a within-subjects design to induce speed variations in a large sample ( = 1,305) of applicants for an air traffic controller training program, we demonstrate the feasibility of manipulating working speed. Our findings confirm the presence of the SAT for most participants, suggesting that traditional ability scores may not fully reflect performance in high-stakes assessments. Importantly, we observed individual differences in the SAT, challenging the assumption of uniform SAT functions across test takers. These results highlight the complexity of interpreting high-stakes assessment outcomes and the influence of test conditions on performance dynamics. This study offers a valuable addition to the methodological toolkit for assessing the intraindividual relationship between speed and accuracy in psychological testing (including SAT research), providing a controlled approach while acknowledging the need to address potential confounders. Future research may apply this method across various cognitive domains, populations, and testing contexts to deepen our understanding of the SAT's broader implications for psychological measurement.
速度-准确性权衡(SAT),即反应速度提高往往会导致准确性下降,这在实验心理学中已得到充分证实。然而,其对心理评估的影响,尤其是在高风险情境下,仍鲜为人知。本研究提出了一种实验方法,用于在高风险空间能力评估中探究SAT。通过在受试者内设计中操纵指令,以在一个大型样本(n = 1305)的空中交通管制员培训项目申请人中诱导速度变化,我们证明了操纵工作速度的可行性。我们的研究结果证实了大多数参与者存在SAT,这表明传统能力分数可能无法完全反映高风险评估中的表现。重要的是,我们观察到SAT存在个体差异,这对所有考生SAT功能一致的假设提出了挑战。这些结果凸显了解释高风险评估结果的复杂性以及测试条件对表现动态的影响。本研究为评估心理测试(包括SAT研究)中速度与准确性之间的个体内关系的方法工具包提供了有价值的补充,提供了一种可控方法,同时认识到需要解决潜在的混杂因素。未来的研究可以将这种方法应用于各种认知领域、人群和测试情境,以加深我们对SAT对心理测量更广泛影响的理解。