Department of Psychology, Boston College, Newton, MA, USA.
Department of Cognitive Science, Vassar College, Poughkeepsie, NY, USA.
Behav Res Methods. 2019 Aug;51(4):1782-1803. doi: 10.3758/s13428-018-1155-z.
Half of the world's population has internet access. In principle, researchers are no longer limited to subjects they can recruit into the laboratory. Any study that can be run on a computer or mobile device can be run with nearly any demographic anywhere in the world, and in large numbers. This has allowed scientists to effectively run hundreds of experiments at once. Despite their transformative power, such studies remain rare for practical reasons: the need for sophisticated software, the difficulty of recruiting so many subjects, and a lack of research paradigms that make effective use of their large amounts of data, due to such realities as that they require sophisticated software in order to run effectively. We present Pushkin: an open-source platform for designing and conducting massive experiments over the internet. Pushkin allows for a wide range of behavioral paradigms, through integration with the intuitive and flexible jsPsych experiment engine. It also addresses the basic technical challenges associated with massive, worldwide studies, including auto-scaling, extensibility, machine-assisted experimental design, multisession studies, and data security.
全球有一半的人口可以上网。原则上，研究人员不再局限于他们可以招募到实验室的对象。任何可以在计算机或移动设备上运行的研究都可以在世界上任何地方的几乎任何人群中以大量的数量进行。这使得科学家能够有效地同时进行数百项实验。尽管这些研究具有变革性的力量，但由于实际原因，它们仍然很少见：需要复杂的软件、招募如此多的受试者的困难，以及缺乏有效的研究范例，因为它们需要复杂的软件才能有效地运行。我们提出了 Pushkin：一个用于通过互联网设计和进行大规模实验的开源平台。Pushkin 通过与直观灵活的 jsPsych 实验引擎集成，支持广泛的行为范例。它还解决了与大规模全球研究相关的基本技术挑战，包括自动扩展、可扩展性、机器辅助实验设计、多会话研究和数据安全。
