Li Wei, Germine Laura Thi, Mehr Samuel A, Srinivasan Mahesh, Hartshorne Joshua
Department of Psychology and Neuroscience, Boston College, Chestnut Hill, MA, USA.
McLean Hospital, Belmont, MA, USA.
Infant Child Dev. 2024 Jan-Feb;33(1). doi: 10.1002/icd.2348. Epub 2022 Aug 2.
Widespread failures of replication and generalization are, ironically, a scientific triumph, in that they confirm the fundamental metascientific theory that underlies our field. Generalizable and replicable findings require testing large numbers of subjects from a wide range of demographics with a large, randomly-sampled stimulus set, and using a variety of experimental parameters. Because few studies accomplish any of this, meta-scientists predict that findings will frequently fail to replicate or generalize. We argue that to be more robust and replicable, developmental psychology needs to find a mechanism for collecting data at greater scale and from more diverse populations. Luckily, this mechanism already exists: Citizen science, in which large numbers of uncompensated volunteers provide data. While best-known for its contributions to astronomy and ecology, citizen science has also produced major findings in neuroscience and psychology, and increasingly in developmental psychology. We provide examples, address practical challenges, discuss limitations, and compare to other methods of obtaining large datasets. Ultimately, we argue that the range of studies where it makes sense not to use citizen science is steadily dwindling.
具有讽刺意味的是,广泛存在的复制和泛化失败却是一项科学成就,因为它们证实了作为我们这个领域基础的元科学基本理论。可泛化且可复制的研究结果需要对来自广泛人口统计学特征的大量受试者进行测试,使用大量随机抽样的刺激集,并采用各种实验参数。由于很少有研究能做到其中任何一点,元科学家预测研究结果常常无法复制或泛化。我们认为,为了更稳健且可复制,发展心理学需要找到一种机制,以便从更广泛的人群中大规模收集数据。幸运的是,这种机制已然存在:公民科学,即大量无报酬的志愿者提供数据。公民科学最为人所知的是其在天文学和生态学方面的贡献,它在神经科学和心理学领域也取得了重大发现,在发展心理学领域的应用也越来越多。我们给出了例子,探讨了实际挑战,讨论了局限性,并与获取大型数据集的其他方法进行了比较。最终,我们认为不适合使用公民科学的研究范围正在稳步缩小。