Michelmann Sebastian, Kumar Manoj, Norman Kenneth A, Toneva Mariya
Department of Psychology, New York University, New York, NY, USA.
Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Behav Res Methods. 2025 Jan 3;57(1):39. doi: 10.3758/s13428-024-02569-z.
Humans perceive discrete events such as "restaurant visits" and "train rides" in their continuous experience. One important prerequisite for studying human event perception is the ability of researchers to quantify when one event ends and another begins. Typically, this information is derived by aggregating behavioral annotations from several observers. Here, we present an alternative computational approach where event boundaries are derived using a large language model, GPT-3, instead of using human annotations. We demonstrate that GPT-3 can segment continuous narrative text into events. GPT-3-annotated events are significantly correlated with human event annotations. Furthermore, these GPT-derived annotations achieve a good approximation of the "consensus" solution (obtained by averaging across human annotations); the boundaries identified by GPT-3 are closer to the consensus, on average, than boundaries identified by individual human annotators. This finding suggests that GPT-3 provides a feasible solution for automated event annotations, and it demonstrates a further parallel between human cognition and prediction in large language models. In the future, GPT-3 may thereby help to elucidate the principles underlying human event perception.
人类在其连续的体验中感知诸如“去餐馆就餐”和“乘坐火车”等离散事件。研究人类事件感知的一个重要前提是研究人员能够量化一个事件何时结束以及另一个事件何时开始。通常,此信息是通过汇总多个观察者的行为注释得出的。在此,我们提出了一种替代的计算方法,其中事件边界是使用大型语言模型GPT-3推导出来的,而不是使用人工注释。我们证明GPT-3可以将连续的叙述文本分割成事件。GPT-3注释的事件与人工事件注释显著相关。此外,这些由GPT得出的注释很好地近似了“共识”解决方案(通过对人工注释求平均值获得);平均而言,GPT-3识别出的边界比单个人工注释者识别出的边界更接近共识。这一发现表明GPT-3为自动事件注释提供了一个可行的解决方案,并且它展示了人类认知与大型语言模型中的预测之间的进一步平行关系。未来,GPT-3可能因此有助于阐明人类事件感知背后的原理。