• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

利用人类颅内脑电图从自然语音中解码语义。

Decoding semantics from natural speech using human intracranial EEG.

作者信息

Pescatore Camille R C, Zhang Haoyu, Hadjinicolaou Alex E, Paulk Angelique C, Rolston John D, Richardson R Mark, Williams Ziv M, Cai Jing, Cash Sydney S

机构信息

Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA.

Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA.

出版信息

bioRxiv. 2025 Feb 11:2025.02.10.637051. doi: 10.1101/2025.02.10.637051.

DOI:10.1101/2025.02.10.637051
PMID:39990331
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11844374/
Abstract

Brain-computer interfaces (BCIs) hold promise for restoring natural language production capabilities in patients with speech impairments, potentially enabling smooth conversation that conveys meaningful information via synthesized words. While considerable progress has been made in decoding phonetic features of speech, our ability to extract lexical semantic information (i.e. the meaning of individual words) from neural activity remains largely unexplored. Moreover, most existing BCI research has relied on controlled experimental paradigms rather than natural conversation, limiting our understanding of semantic decoding in ecological contexts. Here, we investigated the feasibility of decoding lexical semantic information from stereo-electroencephalography (sEEG) recordings in 14 participants during spontaneous conversation. Using multivariate pattern analysis, we were able to decode word level semantic features during language production with an average accuracy of 21% across all participants compared to a chance level of 10%. This semantic decoding remained robust across different semantic representations while maintaining specificity to semantic features. Further, we identified a distributed left-lateralized network spanning precentral gyrus, pars triangularis, and middle temporal cortex, with low-frequency oscillations showing stronger contributions. Together, our results establish the feasibility of extracting word meanings from neural activity during natural speech production and demonstrate the potential for decoding semantic content from unconstrained speech.

摘要

脑机接口(BCIs)有望恢复言语障碍患者的自然语言生成能力,有可能实现通过合成词进行有意义信息传递的流畅对话。虽然在解码语音的语音特征方面已经取得了相当大的进展,但我们从神经活动中提取词汇语义信息(即单个单词的含义)的能力在很大程度上仍未得到探索。此外,大多数现有的脑机接口研究依赖于受控实验范式而非自然对话,这限制了我们对生态环境中语义解码的理解。在此,我们研究了在14名参与者自发对话期间从立体脑电图(sEEG)记录中解码词汇语义信息的可行性。使用多变量模式分析,我们能够在语言生成过程中解码单词级别的语义特征,所有参与者的平均准确率为21%,而随机水平为10%。这种语义解码在不同的语义表示中保持稳健,同时保持对语义特征的特异性。此外,我们确定了一个分布在中央前回、三角部和颞中皮质的左侧化网络,低频振荡显示出更强的贡献。总之,我们的结果确立了在自然言语产生过程中从神经活动中提取单词含义的可行性,并证明了从无约束言语中解码语义内容的潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/4a18441e2e46/nihpp-2025.02.10.637051v1-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/bcabe0368694/nihpp-2025.02.10.637051v1-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/88d149cc5738/nihpp-2025.02.10.637051v1-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/4a18441e2e46/nihpp-2025.02.10.637051v1-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/bcabe0368694/nihpp-2025.02.10.637051v1-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/88d149cc5738/nihpp-2025.02.10.637051v1-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d64b/11844374/4a18441e2e46/nihpp-2025.02.10.637051v1-f0003.jpg

相似文献

1
Decoding semantics from natural speech using human intracranial EEG.利用人类颅内脑电图从自然语音中解码语义。
bioRxiv. 2025 Feb 11:2025.02.10.637051. doi: 10.1101/2025.02.10.637051.
2
Decoding articulatory and phonetic components of naturalistic continuous speech from the distributed language network.从分布式语言网络中解码自然连续语音的发音和语音成分。
J Neural Eng. 2023 Aug 14;20(4). doi: 10.1088/1741-2552/ace9fb.
3
EEG decoding of spoken words in bilingual listeners: from words to language invariant semantic-conceptual representations.双语听众中口语单词的脑电图解码:从单词到语言不变的语义概念表征。
Front Psychol. 2015 Feb 6;6:71. doi: 10.3389/fpsyg.2015.00071. eCollection 2015.
4
Assessing differential representation of hand movements in multiple domains using stereo-electroencephalographic recordings.使用立体脑电图记录评估多个领域中手部运动的差异表征。
Neuroimage. 2022 Apr 15;250:118969. doi: 10.1016/j.neuroimage.2022.118969. Epub 2022 Feb 4.
5
Decoding the meaning of unconsciously processed words using fMRI-based MVPA.使用基于 fMRI 的 MVPA 解码无意识处理的单词的意义。
Neuroimage. 2019 May 1;191:430-440. doi: 10.1016/j.neuroimage.2019.02.010. Epub 2019 Feb 21.
6
Decoding Semantics from Dynamic Brain Activation Patterns: From Trials to Task in EEG/MEG Source Space.从动态脑激活模式中解码语义:在 EEG/MEG 源空间中从试验到任务。
eNeuro. 2024 Mar 4;11(3). doi: 10.1523/ENEURO.0277-23.2023. Print 2024 Mar.
7
Localization of Phonological and Semantic Contributions to Reading.语音和语义对阅读的贡献的定位。
J Neurosci. 2019 Jul 3;39(27):5361-5368. doi: 10.1523/JNEUROSCI.2707-18.2019. Epub 2019 May 6.
8
Neural decoding of speech with semantic-based classification.基于语义分类的语音神经解码。
Cortex. 2022 Sep;154:231-240. doi: 10.1016/j.cortex.2022.05.018. Epub 2022 Jun 8.
9
A brain-to-text framework for decoding natural tonal sentences.一种用于解码自然声调句子的脑到文本框架。
Cell Rep. 2024 Nov 26;43(11):114924. doi: 10.1016/j.celrep.2024.114924. Epub 2024 Oct 31.
10
The use of intracranial recordings to decode human language: Challenges and opportunities.利用颅内记录解码人类语言:挑战与机遇。
Brain Lang. 2019 Jun;193:73-83. doi: 10.1016/j.bandl.2016.06.003. Epub 2016 Jul 1.

本文引用的文献

1
Natural language processing models reveal neural dynamics of human conversation.自然语言处理模型揭示了人类对话的神经动力学。
Nat Commun. 2025 Apr 9;16(1):3376. doi: 10.1038/s41467-025-58620-w.
2
Decoding the brain: From neural representations to mechanistic models.解码大脑:从神经表示到机制模型。
Cell. 2024 Oct 17;187(21):5814-5832. doi: 10.1016/j.cell.2024.08.051.
3
An Accurate and Rapidly Calibrating Speech Neuroprosthesis.一种精确且快速校准的语音神经假体。
N Engl J Med. 2024 Aug 15;391(7):609-618. doi: 10.1056/NEJMoa2314132.
4
A shared model-based linguistic space for transmitting our thoughts from brain to brain in natural conversations.在自然对话中,通过共享基于模型的语言空间,将我们的思想从大脑传送到大脑。
Neuron. 2024 Sep 25;112(18):3211-3222.e5. doi: 10.1016/j.neuron.2024.06.025. Epub 2024 Aug 2.
5
Semantic encoding during language comprehension at single-cell resolution.单细胞分辨率下语言理解过程中的语义编码。
Nature. 2024 Jul;631(8021):610-616. doi: 10.1038/s41586-024-07643-2. Epub 2024 Jul 3.
6
The speech neuroprosthesis.言语神经假体。
Nat Rev Neurosci. 2024 Jul;25(7):473-492. doi: 10.1038/s41583-024-00819-9. Epub 2024 May 14.
7
The language network as a natural kind within the broader landscape of the human brain.语言网络作为人类大脑更广阔景观中的一种自然类别。
Nat Rev Neurosci. 2024 May;25(5):289-312. doi: 10.1038/s41583-024-00802-4. Epub 2024 Apr 12.
8
The spatiotemporal dynamics of semantic integration in the human brain.人类大脑中语义整合的时空动态。
Nat Commun. 2023 Oct 24;14(1):6336. doi: 10.1038/s41467-023-42087-8.
9
A high-performance neuroprosthesis for speech decoding and avatar control.一种用于语音解码和化身控制的高性能神经假体。
Nature. 2023 Aug;620(7976):1037-1046. doi: 10.1038/s41586-023-06443-4. Epub 2023 Aug 23.
10
A high-performance speech neuroprosthesis.高性能言语神经假体
Nature. 2023 Aug;620(7976):1031-1036. doi: 10.1038/s41586-023-06377-x. Epub 2023 Aug 23.