• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用皮层脑电图解码内心言语:言语假体的进展与挑战

Decoding Inner Speech Using Electrocorticography: Progress and Challenges Toward a Speech Prosthesis.

作者信息

Martin Stephanie, Iturrate Iñaki, Millán José Del R, Knight Robert T, Pasley Brian N

机构信息

Defitech Chair in Brain Machine Interface, Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.

Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, United States.

出版信息

Front Neurosci. 2018 Jun 21;12:422. doi: 10.3389/fnins.2018.00422. eCollection 2018.

DOI:10.3389/fnins.2018.00422
PMID:29977189
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6021529/
Abstract

Certain brain disorders resulting from brainstem infarcts, traumatic brain injury, cerebral palsy, stroke, and amyotrophic lateral sclerosis, limit verbal communication despite the patient being fully aware. People that cannot communicate due to neurological disorders would benefit from a system that can infer internal speech directly from brain signals. In this review article, we describe the state of the art in decoding inner speech, ranging from early acoustic sound features, to higher order speech units. We focused on intracranial recordings, as this technique allows monitoring brain activity with high spatial, temporal, and spectral resolution, and therefore is a good candidate to investigate inner speech. Despite intense efforts, investigating how the human cortex encodes inner speech remains an elusive challenge, due to the lack of behavioral and observable measures. We emphasize various challenges commonly encountered when investigating inner speech decoding, and propose potential solutions in order to get closer to a natural speech assistive device.

摘要

某些由脑干梗死、创伤性脑损伤、脑瘫、中风和肌萎缩侧索硬化症导致的脑部疾病,尽管患者意识完全清醒,但仍会限制言语交流。因神经障碍而无法交流的人将受益于一种能够直接从脑信号推断内部言语的系统。在这篇综述文章中,我们描述了从早期声学特征到高阶言语单元的内部言语解码的最新技术水平。我们专注于颅内记录,因为这项技术能够以高空间、时间和频谱分辨率监测大脑活动,因此是研究内部言语的理想选择。尽管付出了巨大努力,但由于缺乏行为和可观察的测量方法,研究人类皮层如何编码内部言语仍然是一个难以捉摸的挑战。我们强调了在研究内部言语解码时常见的各种挑战,并提出了潜在的解决方案,以便更接近自然的言语辅助设备。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/ca0bc282b640/fnins-12-00422-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/c6eede03e874/fnins-12-00422-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/54e28c318851/fnins-12-00422-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/ca0bc282b640/fnins-12-00422-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/c6eede03e874/fnins-12-00422-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/54e28c318851/fnins-12-00422-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2a49/6021529/ca0bc282b640/fnins-12-00422-g0003.jpg

相似文献

1
Decoding Inner Speech Using Electrocorticography: Progress and Challenges Toward a Speech Prosthesis.使用皮层脑电图解码内心言语:言语假体的进展与挑战
Front Neurosci. 2018 Jun 21;12:422. doi: 10.3389/fnins.2018.00422. eCollection 2018.
2
The use of intracranial recordings to decode human language: Challenges and opportunities.利用颅内记录解码人类语言:挑战与机遇。
Brain Lang. 2019 Jun;193:73-83. doi: 10.1016/j.bandl.2016.06.003. Epub 2016 Jul 1.
3
Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication.脑机接口:应用于语音解码和合成以增强交流。
Neurotherapeutics. 2022 Jan;19(1):263-273. doi: 10.1007/s13311-022-01190-2. Epub 2022 Jan 31.
4
High-resolution neural recordings improve the accuracy of speech decoding.高分辨率神经记录提高了语音解码的准确性。
Nat Commun. 2023 Nov 6;14(1):6938. doi: 10.1038/s41467-023-42555-1.
5
The current state of electrocorticography-based brain-computer interfaces.基于脑电描记术的脑机接口的现状。
Neurosurg Focus. 2020 Jul;49(1):E2. doi: 10.3171/2020.4.FOCUS20185.
6
Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids.利用高密度 ECoG 网格从感觉运动皮层解码口语音素。
Neuroimage. 2018 Oct 15;180(Pt A):301-311. doi: 10.1016/j.neuroimage.2017.10.011. Epub 2017 Oct 7.
7
Real-time detection of spoken speech from unlabeled ECoG signals: A pilot study with an ALS participant.从未标记的脑皮层电图信号中实时检测语音:对一名肌萎缩侧索硬化症患者的初步研究。
medRxiv. 2024 Sep 22:2024.09.18.24313755. doi: 10.1101/2024.09.18.24313755.
8
Decoding Speech With Integrated Hybrid Signals Recorded From the Human Ventral Motor Cortex.利用从人类腹侧运动皮层记录的集成混合信号解码语音。
Front Neurosci. 2018 Apr 5;12:221. doi: 10.3389/fnins.2018.00221. eCollection 2018.
9
Recording human electrocorticographic (ECoG) signals for neuroscientific research and real-time functional cortical mapping.记录用于神经科学研究和实时功能性皮层图谱绘制的人类皮层脑电图(ECoG)信号。
J Vis Exp. 2012 Jun 26(64):3993. doi: 10.3791/3993.
10
The nested hierarchy of overt, mouthed, and imagined speech activity evident in intracranial recordings.颅内记录中明显存在的外显、口头和想象言语活动的嵌套层次结构。
Neuroimage. 2023 Apr 1;269:119913. doi: 10.1016/j.neuroimage.2023.119913. Epub 2023 Jan 31.

引用本文的文献

1
Inner speech in motor cortex and implications for speech neuroprostheses.运动皮层中的内部言语及其对言语神经假体的意义。
Cell. 2025 Jul 9. doi: 10.1016/j.cell.2025.06.015.
2
Neural signals, machine learning, and the future of inner speech recognition.神经信号、机器学习与内心言语识别的未来
Front Hum Neurosci. 2025 Jul 10;19:1637174. doi: 10.3389/fnhum.2025.1637174. eCollection 2025.
3
Natural sounds can be reconstructed from human neuroimaging data using deep neural network representation.利用深度神经网络表示,可以从人类神经成像数据中重建自然声音。

本文引用的文献

1
Human Sensorimotor Cortex Control of Directly Measured Vocal Tract Movements during Vowel Production.人类感觉运动皮层对元音产生期间直接测量的声道运动的控制。
J Neurosci. 2018 Mar 21;38(12):2955-2966. doi: 10.1523/JNEUROSCI.2382-17.2018. Epub 2018 Feb 8.
2
Real-time classification of auditory sentences using evoked cortical activity in humans.使用人类诱发皮层活动实时分类听觉句子。
J Neural Eng. 2018 Jun;15(3):036005. doi: 10.1088/1741-2552/aaab6f. Epub 2018 Jan 30.
3
Neural Encoding of Auditory Features during Music Perception and Imagery.
PLoS Biol. 2025 Jul 23;23(7):e3003293. doi: 10.1371/journal.pbio.3003293. eCollection 2025 Jul.
4
Learning to operate an imagined speech Brain-Computer Interface involves the spatial and frequency tuning of neural activity.学习操作想象中的语音脑机接口涉及神经活动的空间和频率调谐。
Commun Biol. 2025 Feb 20;8(1):271. doi: 10.1038/s42003-025-07464-7.
5
Rethinking the Methods and Algorithms for Inner Speech Decoding and Making Them Reproducible.重新思考内心言语解码的方法和算法并使其具有可重复性。
NeuroSci. 2022 Apr 19;3(2):226-244. doi: 10.3390/neurosci3020017. eCollection 2022 Jun.
6
Imagined speech event detection from electrocorticography and its transfer between speech modes and subjects.从脑电信号中检测想象的言语事件及其在言语模式和被试间的迁移。
Commun Biol. 2024 Jul 5;7(1):818. doi: 10.1038/s42003-024-06518-6.
7
The speech neuroprosthesis.言语神经假体。
Nat Rev Neurosci. 2024 Jul;25(7):473-492. doi: 10.1038/s41583-024-00819-9. Epub 2024 May 14.
8
Representation of internal speech by single neurons in human supramarginal gyrus.人类缘上回听皮层中单个神经元对内部言语的表征。
Nat Hum Behav. 2024 Jun;8(6):1136-1149. doi: 10.1038/s41562-024-01867-y. Epub 2024 May 13.
9
Adaptive LDA Classifier Enhances Real-Time Control of an EEG Brain-Computer Interface for Decoding Imagined Syllables.自适应线性判别分析分类器增强了用于解码想象音节的脑电图脑机接口的实时控制。
Brain Sci. 2024 Feb 21;14(3):196. doi: 10.3390/brainsci14030196.
10
Anatomical registration of intracranial electrodes. Robust model-based localization and deformable smooth brain-shift compensation methods.颅内电极的解剖配准。基于稳健模型的定位和可变形平滑脑移位补偿方法。
J Neurosci Methods. 2024 Apr;404:110056. doi: 10.1016/j.jneumeth.2024.110056. Epub 2024 Jan 14.
听觉特征在音乐感知和想象过程中的神经编码。
Cereb Cortex. 2018 Dec 1;28(12):4222-4233. doi: 10.1093/cercor/bhx277.
4
Spatiotemporal dynamics of information encoding revealed in orbitofrontal high-gamma.揭示眶额皮质高频γ中信息编码的时空动态
Nat Commun. 2017 Oct 26;8(1):1139. doi: 10.1038/s41467-017-01253-5.
5
Encoding and Decoding Models in Cognitive Electrophysiology.认知神经电生理学中的编码与解码模型
Front Syst Neurosci. 2017 Sep 26;11:61. doi: 10.3389/fnsys.2017.00061. eCollection 2017.
6
Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration.脑控肌肉刺激恢复四肢瘫痪患者的上肢运动:概念验证研究。
Lancet. 2017 May 6;389(10081):1821-1830. doi: 10.1016/S0140-6736(17)30601-3. Epub 2017 Mar 28.
7
High performance communication by people with paralysis using an intracortical brain-computer interface.瘫痪患者使用皮层内脑机接口进行的高效通信。
Elife. 2017 Feb 21;6:e18554. doi: 10.7554/eLife.18554.
8
Perceptual restoration of masked speech in human cortex.人类大脑皮层中掩蔽语音的感知恢复。
Nat Commun. 2016 Dec 20;7:13619. doi: 10.1038/ncomms13619.
9
Rapid tuning shifts in human auditory cortex enhance speech intelligibility.快速调谐人听觉皮层的转变增强了言语可懂度。
Nat Commun. 2016 Dec 20;7:13654. doi: 10.1038/ncomms13654.
10
Fully Implanted Brain-Computer Interface in a Locked-In Patient with ALS.为一名闭锁综合征的肌萎缩侧索硬化症患者植入的完全植入式脑机接口
N Engl J Med. 2016 Nov 24;375(21):2060-2066. doi: 10.1056/NEJMoa1608085. Epub 2016 Nov 12.