Department of Psychology, The Hebrew University of Jerusalem, Mt. Scopus, 91905, Jerusalem, Israel.
Department of Psychology, Ben-Gurion University of the Negev, Beer-Sheva, Israel.
Behav Res Methods. 2024 Mar;56(3):1984-1993. doi: 10.3758/s13428-023-02131-3. Epub 2023 May 1.
The affordances task serves as an important tool for the assessment of cognition and visuomotor functioning, and yet its test-retest reliability has not been established. In the affordances task, participants attend to a goal-directed task (e.g., classifying manipulable objects such as cups and pots) while suppressing their stimulus-driven, irrelevant reactions afforded by these objects (e.g., grasping their handles). This results in cognitive conflicts manifesting at the task level and the response level. In the current study, we assessed the reliability of the affordances task for the first time. While doing so, we referred to the "reliability paradox," according to which behavioral tasks that produce highly replicable group-level effects often yield low test-retest reliability due to the inadequacy of traditional correlation methods in capturing individual differences between participants. Alongside the simple test-retest correlations, we employed a Bayesian generative model that was recently demonstrated to result in a more precise estimation of test-retest reliability. Two hundred and ninety-five participants completed an online version of the affordances task twice, with a one-week gap. Performance on the online version replicated results obtained under in-lab administrations of the task. While the simple correlation method resulted in weak test-retest measures of the different effects, the generative model yielded a good reliability assessment. The current results support the utility of the affordances task as a reliable behavioral tool for the assessment of group-level and individual differences in cognitive and visuomotor functioning. The results further support the employment of generative modeling in the study of individual differences.
可供性任务是评估认知和运动功能的重要工具,但它的重测信度尚未建立。在可供性任务中,参与者专注于一个目标导向的任务(例如,对可操作的物体进行分类,如杯子和锅),同时抑制这些物体提供的刺激驱动的、不相关的反应(例如,抓住它们的把手)。这导致认知冲突在任务层面和反应层面表现出来。在本研究中,我们首次评估了可供性任务的可靠性。在这样做的同时,我们参考了“可靠性悖论”,即产生高度可复制的组水平效应的行为任务由于传统相关方法在捕捉参与者之间的个体差异方面的不足,往往产生低重测信度。除了简单的重测相关外,我们还采用了一种最近被证明可以更精确地估计重测信度的贝叶斯生成模型。295 名参与者在一周的间隔内两次完成了可供性任务的在线版本。在线版本的表现复制了在实验室进行任务时获得的结果。虽然简单的相关方法得出了不同效应的重测信度较低的结果,但生成模型得出了良好的可靠性评估。目前的结果支持可供性任务作为评估认知和运动功能的组水平和个体差异的可靠行为工具的效用。结果进一步支持在个体差异研究中使用生成建模。