Paré Dwayne E, Cree George S
University of Toronto Scarborough, Toronto, Ontario, Canada.
Behav Res Methods. 2009 Aug;41(3):699-704. doi: 10.3758/BRM.41.3.699.
It has been demonstrated previously that, for some experimental paradigms, Web-based research can reliably replicate lab-based results. Yet questions remain as to what types of research can be reproduced, and where differences arise when they cannot be. The present article examines the effect of research location (laboratory vs. online) on normative data collection tasks. Specifically, participants were randomly assigned to a laboratory or online condition and were asked to rate 593 photorealistic images on the basis of object familiarity (N=103) and object visual complexity (N=98). Dependent measures were compared across location conditions, including response latencies and image rating agreement. Our results suggest that norming data collected online are reliable, but an interesting interplay between task type and research location was observed. Specifically, we found that participating online (i.e., a more familiar environment) leads to systematically higher familiarity ratings than in the lab (i.e., an unfamiliar environment). These differences are not found when the alternate complexity rating task is used.
先前已经证明，对于某些实验范式，基于网络的研究能够可靠地复制基于实验室的结果。然而，关于哪些类型的研究可以被重复，以及当它们无法被重复时差异出现在何处，仍然存在问题。本文研究了研究地点（实验室与在线）对规范数据收集任务的影响。具体而言，参与者被随机分配到实验室或在线条件下，并被要求根据物体熟悉度（N = 103）和物体视觉复杂度（N = 98）对593张逼真图像进行评分。对不同地点条件下的相关测量指标进行了比较，包括反应潜伏期和图像评分一致性。我们的结果表明，在线收集的规范数据是可靠的，但观察到任务类型和研究地点之间存在有趣的相互作用。具体而言，我们发现在线参与（即更熟悉的环境）会导致熟悉度评分系统地高于实验室（即不熟悉的环境）。当使用替代的复杂度评分任务时，未发现这些差异。
