Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands.
Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel.
Behav Res Methods. 2024 Aug;56(5):4836-4849. doi: 10.3758/s13428-023-02221-2. Epub 2023 Aug 30.
The many benefits of online research and the recent emergence of open-source eye-tracking libraries have sparked an interest in transferring time-consuming and expensive eye-tracking studies from the lab to the web. In the current study, we validate online webcam-based eye-tracking by conceptually replicating three robust eye-tracking studies (the cascade effect, n = 134, the novelty preference, n = 45, and the visual world paradigm, n = 32) online using the participant's webcam as eye-tracker with the WebGazer.js library. We successfully replicated all three effects, although the effect sizes of all three studies shrank by 20-27%. The visual world paradigm was conducted both online and in the lab, using the same participants and a standard laboratory eye-tracker. The results showed that replication per se could not fully account for the effect size shrinkage, but that the shrinkage was also due to the use of online webcam-based eye-tracking, which is noisier. In conclusion, we argue that eye-tracking studies with relatively large effects that do not require extremely high precision (e.g., studies with four or fewer large regions of interest) can be done online using the participant's webcam. We also make recommendations for how the quality of online webcam-based eye-tracking could be improved.
在线研究的诸多好处以及开源眼动追踪库的新近出现,激发了人们将耗时且昂贵的眼动追踪研究从实验室转移到网络上的兴趣。在本研究中,我们使用 WebGazer.js 库,通过概念复制三个稳健的眼动追踪研究(级联效应,n=134;新颖偏好,n=45;视觉世界范式,n=32),在线使用参与者的网络摄像头作为眼动追踪器,验证了在线网络摄像头眼动追踪的有效性。我们成功复制了所有三个效应,尽管所有三个研究的效应大小都缩小了 20-27%。视觉世界范式既在线上又在实验室中进行,使用相同的参与者和标准的实验室眼动追踪器。结果表明,复制本身并不能完全解释效应大小的缩小,但缩小也是由于使用了噪音更大的在线网络摄像头眼动追踪。总之,我们认为,使用参与者的网络摄像头进行在线眼动追踪,可以完成相对较大效应且不需要极高精度的眼动追踪研究(例如,具有四个或更少大感兴趣区域的研究)。我们还提出了如何提高在线网络摄像头眼动追踪质量的建议。