• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

关于意外性,有什么令人惊讶之处?

What's Surprising About Surprisal.

作者信息

Slaats Sophie, Martin Andrea E

机构信息

Max Planck Institute for Psycholinguistics, Wundtlaan 1, 6525 XD Nijmegen, The Netherlands.

Departement de Neurosciences Fondamentales, Université de Genève, Chemin Des Mines 9, 1202 Geneva, Switzerland.

出版信息

Comput Brain Behav. 2025;8(2):233-248. doi: 10.1007/s42113-025-00237-9. Epub 2025 Feb 21.

DOI:10.1007/s42113-025-00237-9
PMID:40453151
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12125142/
Abstract

UNLABELLED

In the computational and experimental psycholinguistic literature, the mechanisms behind syntactic structure building (e.g., combining words into phrases and sentences) are the subject of considerable debate. Much experimental work has shown that surprisal is a good predictor of human behavioral and neural data. These findings have led some authors to model language comprehension in a purely probabilistic way. In this paper, we use simulation to exemplify why surprisal works so well to model human data and to illustrate why exclusive reliance on it can be problematic for the development of mechanistic theories of language comprehension, particularly those with emphasis on meaning composition. Rather than arguing for the importance of structural or probabilistic information to the exclusion or exhaustion of the other, we argue more emphasis should be placed on understanding how the brain leverages both types of information (viz., statistical and structured). We propose that probabilistic information is an important to the structure in the message, but is not a substitute for the structure itself-neither computationally, formally, nor conceptually. Surprisal and other probabilistic metrics must play a key role as theoretical objects in any explanatory mechanistic theory of language processing, but that role remains in the service of the brain's goal of constructing structured meaning from sensory input.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s42113-025-00237-9.

摘要

未标注

在计算和实验心理语言学文献中,句法结构构建背后的机制(例如,将单词组合成短语和句子)是一个备受争议的话题。大量实验工作表明,意外性是人类行为和神经数据的良好预测指标。这些发现导致一些作者以纯粹概率的方式对语言理解进行建模。在本文中,我们通过模拟来说明为什么意外性在模拟人类数据方面表现出色,并说明为什么单纯依赖它对于语言理解机制理论的发展可能存在问题,特别是那些强调意义组合的理论。我们并非主张结构或概率信息的重要性要排斥或耗尽另一方,而是主张应更加重视理解大脑如何利用这两种信息(即统计信息和结构化信息)。我们提出,概率信息是消息中结构的重要补充,但在计算、形式或概念上都不能替代结构本身。意外性和其他概率指标在任何语言处理的解释性机制理论中都必须作为理论对象发挥关键作用,但该作用仍然是为了大脑从感官输入构建结构化意义这一目标服务。

补充信息

在线版本包含可在10.1007/s42113-025-00237-9获取的补充材料。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/55260b03809d/42113_2025_237_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/73022f495613/42113_2025_237_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/7a3385ea3109/42113_2025_237_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/5e716c9461bc/42113_2025_237_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/e13ced442124/42113_2025_237_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/0e97c38fb0f8/42113_2025_237_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/eee3ec13ece2/42113_2025_237_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/d1ed9d83bb7c/42113_2025_237_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/99dd27401c5d/42113_2025_237_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/55260b03809d/42113_2025_237_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/73022f495613/42113_2025_237_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/7a3385ea3109/42113_2025_237_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/5e716c9461bc/42113_2025_237_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/e13ced442124/42113_2025_237_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/0e97c38fb0f8/42113_2025_237_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/eee3ec13ece2/42113_2025_237_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/d1ed9d83bb7c/42113_2025_237_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/99dd27401c5d/42113_2025_237_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/564e/12125142/55260b03809d/42113_2025_237_Fig9_HTML.jpg

相似文献

1
What's Surprising About Surprisal.关于意外性,有什么令人惊讶之处?
Comput Brain Behav. 2025;8(2):233-248. doi: 10.1007/s42113-025-00237-9. Epub 2025 Feb 21.
2
Locality and expectation effects in Hindi preverbal constituent ordering.印地语动词前成分语序中的局部性和预期性效应。
Cognition. 2022 Jun;223:104959. doi: 10.1016/j.cognition.2021.104959. Epub 2022 Jan 25.
3
Language structure in the brain: A fixation-related fMRI study of syntactic surprisal in reading.大脑中的语言结构:一项关于阅读中句法意外性的与注视相关的功能磁共振成像研究。
Neuroimage. 2016 May 15;132:293-300. doi: 10.1016/j.neuroimage.2016.02.050. Epub 2016 Feb 22.
4
Lexical Surprisal Shapes the Time Course of Syntactic Structure Building.词汇意外性塑造句法结构构建的时间进程。
Neurobiol Lang (Camb). 2024 Oct 11;5(4):942-980. doi: 10.1162/nol_a_00155. eCollection 2024.
5
Prior Context and Individual Alpha Frequency Influence Predictive Processing during Language Comprehension.先前语境和个体阿尔法频率影响语言理解中的预测加工。
J Cogn Neurosci. 2024 Sep 1;36(9):1898-1936. doi: 10.1162/jocn_a_02196.
6
Effects of Surprisal and Locality on Danish Sentence Processing: An Eye-Tracking Investigation.意外性和局部性对丹麦语句子处理的影响:一项眼动追踪研究。
J Psycholinguist Res. 2017 Oct;46(5):1119-1136. doi: 10.1007/s10936-017-9482-2.
7
Brain and grammar: revealing electrophysiological basic structures with competing statistical models.大脑与语法:利用竞争统计模型揭示电生理基本结构。
Cereb Cortex. 2024 Aug 1;34(8). doi: 10.1093/cercor/bhae317.
8
A resource-rational model of human processing of recursive linguistic structure.递归语言结构的人类处理的资源理性模型。
Proc Natl Acad Sci U S A. 2022 Oct 25;119(43):e2122602119. doi: 10.1073/pnas.2122602119. Epub 2022 Oct 19.
9
Robust Effects of Working Memory Demand during Naturalistic Language Comprehension in Language-Selective Cortex.自然语言理解过程中工作记忆需求对语言选择皮层的强大影响。
J Neurosci. 2022 Sep 28;42(39):7412-7430. doi: 10.1523/JNEUROSCI.1894-21.2022.
10
Neurobehavioral Correlates of Surprisal in Language Comprehension: A Neurocomputational Model.语言理解中意外感的神经行为关联:一种神经计算模型。
Front Psychol. 2021 Feb 11;12:615538. doi: 10.3389/fpsyg.2021.615538. eCollection 2021.

本文引用的文献

1
Lexical Surprisal Shapes the Time Course of Syntactic Structure Building.词汇意外性塑造句法结构构建的时间进程。
Neurobiol Lang (Camb). 2024 Oct 11;5(4):942-980. doi: 10.1162/nol_a_00155. eCollection 2024.
2
Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects.强预测:语言模型意外值解释多种N400效应。
Neurobiol Lang (Camb). 2024 Apr 1;5(1):107-135. doi: 10.1162/nol_a_00105. eCollection 2024.
3
A tradeoff between acoustic and linguistic feature encoding in spoken language comprehension.口语理解中声学和语言特征编码之间的权衡。
Elife. 2023 Jul 7;12:e82386. doi: 10.7554/eLife.82386.
4
Delta-Band Neural Responses to Individual Words Are Modulated by Sentence Processing.Delta 波段神经对单个单词的反应受句子处理的调节。
J Neurosci. 2023 Jun 28;43(26):4867-4883. doi: 10.1523/JNEUROSCI.0964-22.2023. Epub 2023 May 23.
5
A hierarchy of linguistic predictions during natural language comprehension.自然语言理解过程中的语言预测层次。
Proc Natl Acad Sci U S A. 2022 Aug 9;119(32):e2201968119. doi: 10.1073/pnas.2201968119. Epub 2022 Aug 3.
6
Neural dynamics differentially encode phrases and sentences during spoken language comprehension.在口语理解过程中,神经动力学对短语和句子进行了不同的编码。
PLoS Biol. 2022 Jul 14;20(7):e3001713. doi: 10.1371/journal.pbio.3001713. eCollection 2022 Jul.
7
Neural tracking of phrases in spoken language comprehension is automatic and task-dependent.口语理解中的短语神经追踪是自动的且依赖于任务的。
Elife. 2022 Jul 14;11:e77468. doi: 10.7554/eLife.77468.
8
Neural Markers of Speech Comprehension: Measuring EEG Tracking of Linguistic Speech Representations, Controlling the Speech Acoustics.言语理解的神经标记物:测量 EEG 追踪语言言语表征,控制言语声学。
J Neurosci. 2021 Dec 15;41(50):10316-10329. doi: 10.1523/JNEUROSCI.0812-21.2021. Epub 2021 Nov 3.
9
Comparing predictors of sentence self-paced reading times: Syntactic complexity versus transitional probability metrics.比较句子自定阅读时间的预测指标:句法复杂度与过渡概率指标。
PLoS One. 2021 Jul 12;16(7):e0254546. doi: 10.1371/journal.pone.0254546. eCollection 2021.
10
Single-Stage Prediction Models Do Not Explain the Magnitude of Syntactic Disambiguation Difficulty.单阶段预测模型无法解释句法消歧难度的大小。
Cogn Sci. 2021 Jun;45(6):e12988. doi: 10.1111/cogs.12988.