Neuroscience Research Australia, Margarete Ainsworth Building, Barker Street, Randwick, 2031, New South Wales, Australia.
Prince of Wales Clinical School, University of New South Wales, Sydney, Australia.
Behav Res Methods. 2018 Oct;50(5):1778-1792. doi: 10.3758/s13428-017-0946-y.
Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test-retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test-retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test-retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from -.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test-retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.
眼动追踪通常用于研究注意偏向。尽管一些研究已经调查了眼动追踪的内部一致性，但关于眼动追踪研究注意偏向的重测信度和一致性的数据却很少。本研究报告了 12 种常用的测量方法的重测信度、测量误差和内部一致性，这些方法被认为反映了注意偏向的不同成分：总体注意、早期注意和晚期注意。健康参与者完成了一项偏好性眼动追踪任务，该任务涉及呈现威胁性（感觉词、一般威胁词和情感词）和非威胁性词。我们使用组内相关系数（ICC）来衡量重测信度（ICC>.70 表示信度足够）。ICC(2,1)范围从-.31 到.71。可靠性因测量方法和威胁词类别而异。感觉词的平均 ICC（.08）低于情感词（.32）或一般威胁词（.29）。更长的暴露时间与更高的重测信度相关。除了第二运行停留时间外，所有的测量方法都表现出较低的测量误差（<6%）。大多数测量方法的内部一致性较高（α>.93）。为了提高未来研究中眼动追踪任务的可靠性，提出了一些建议。
