• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

利用神经信号调制的时间来解码语音。

Decoding speech using the timing of neural signal modulation.

作者信息

Jiang Werner, Pailla Tejaswy, Dichter Benjamin, Chang Edward F, Gilja Vikash

出版信息

Annu Int Conf IEEE Eng Med Biol Soc. 2016 Aug;2016:1532-1535. doi: 10.1109/EMBC.2016.7591002.

DOI:10.1109/EMBC.2016.7591002
PMID:28268618
Abstract

Brain-machine interfaces (BMIs) have great potential for applications that restore and assist communication for paralyzed individuals. Recently, BMIs decoding speech have gained considerable attention due to their potential for high information transfer rates. In this study, we propose a novel decoding approach based on hidden Markov models (HMMs) that uses the timing of neural signal changes to decode speech. We tested the decoder's performance by predicting vowels from electrocorticographic (ECoG) data of three human subjects. Our results show that timing-based features of ECoG signals are informative of vowel production and enable decoding accuracies significantly above the level of chance. This suggests that leveraging the temporal structure of neural activity to decode speech could play an important role towards developing highperformance, robust speech BMIs.

摘要

脑机接口(BMI)在恢复和辅助瘫痪患者进行交流的应用方面具有巨大潜力。最近,能够解码语音的BMI因其具有高信息传输率的潜力而备受关注。在本研究中,我们提出了一种基于隐马尔可夫模型(HMM)的新型解码方法,该方法利用神经信号变化的时间来解码语音。我们通过预测三名人类受试者的脑皮层电图(ECoG)数据中的元音来测试解码器的性能。我们的结果表明,ECoG信号基于时间的特征能够提供有关元音产生的信息,并使解码准确率显著高于随机水平。这表明利用神经活动的时间结构来解码语音对于开发高性能、稳健的语音BMI可能发挥重要作用。

相似文献

1
Decoding speech using the timing of neural signal modulation.利用神经信号调制的时间来解码语音。
Annu Int Conf IEEE Eng Med Biol Soc. 2016 Aug;2016:1532-1535. doi: 10.1109/EMBC.2016.7591002.
2
High-resolution neural recordings improve the accuracy of speech decoding.高分辨率神经记录提高了语音解码的准确性。
Nat Commun. 2023 Nov 6;14(1):6938. doi: 10.1038/s41467-023-42555-1.
3
Brain-to-speech decoding will require linguistic and pragmatic data.脑语解码将需要语言和语用数据。
J Neural Eng. 2018 Dec;15(6):063001. doi: 10.1088/1741-2552/aae466. Epub 2018 Sep 26.
4
The influence of prior pronunciations on sensorimotor cortex activity patterns during vowel production.先前发音对元音产生过程中运动感觉皮层活动模式的影响。
J Neural Eng. 2018 Dec;15(6):066025. doi: 10.1088/1741-2552/aae329. Epub 2018 Sep 21.
5
Brain2Char: a deep architecture for decoding text from brain recordings.脑到字符:一种从脑记录中解码文本的深度架构。
J Neural Eng. 2020 Dec 16;17(6). doi: 10.1088/1741-2552/abc742.
6
The Potential for a Speech Brain-Computer Interface Using Chronic Electrocorticography.利用慢性皮层脑电图实现语音脑-机接口的潜力
Neurotherapeutics. 2019 Jan;16(1):144-165. doi: 10.1007/s13311-018-00692-2.
7
Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids.利用高密度 ECoG 网格从感觉运动皮层解码口语音素。
Neuroimage. 2018 Oct 15;180(Pt A):301-311. doi: 10.1016/j.neuroimage.2017.10.011. Epub 2017 Oct 7.
8
Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication.脑机接口:应用于语音解码和合成以增强交流。
Neurotherapeutics. 2022 Jan;19(1):263-273. doi: 10.1007/s13311-022-01190-2. Epub 2022 Jan 31.
9
Machine learning algorithm for decoding multiple subthalamic spike trains for speech brain-machine interfaces.用于解码语音脑机接口中多个丘脑下刺脉冲序列的机器学习算法。
J Neural Eng. 2021 Nov 25;18(6). doi: 10.1088/1741-2552/ac3315.
10
Neural decoding of electrocorticographic signals using dynamic mode decomposition.使用动态模态分解对脑电信号进行神经解码。
J Neural Eng. 2020 Jun 2;17(3):036009. doi: 10.1088/1741-2552/ab8910.

引用本文的文献

1
High-resolution neural recordings improve the accuracy of speech decoding.高分辨率神经记录提高了语音解码的准确性。
Nat Commun. 2023 Nov 6;14(1):6938. doi: 10.1038/s41467-023-42555-1.
2
Online speech synthesis using a chronically implanted brain-computer interface in an individual with ALS.在一名肌萎缩侧索硬化症患者中使用长期植入式脑机接口进行在线语音合成。
medRxiv. 2023 Jul 1:2023.06.30.23291352. doi: 10.1101/2023.06.30.23291352.
3
Local field potentials in a pre-motor region predict learned vocal sequences.局部场电位在前运动区预测学习的发声序列。
PLoS Comput Biol. 2021 Sep 23;17(9):e1008100. doi: 10.1371/journal.pcbi.1008100. eCollection 2021 Sep.
4
Decoding spoken English from intracortical electrode arrays in dorsal precentral gyrus.从中央前回背侧的皮层内电极阵列解码英语口语。
J Neural Eng. 2020 Nov 25;17(6):066007. doi: 10.1088/1741-2552/abbfef.
5
Histological Confirmation of Myelinated Neural Filaments Within the Tip of the Neurotrophic Electrode After a Decade of Neural Recordings.经过十年的神经记录后,对神经营养电极尖端内有髓神经丝的组织学确认。
Front Hum Neurosci. 2020 Apr 21;14:111. doi: 10.3389/fnhum.2020.00111. eCollection 2020.
6
Neural ensemble dynamics in dorsal motor cortex during speech in people with paralysis.人在瘫痪时说话时背侧运动皮层中的神经集合动力学。
Elife. 2019 Dec 10;8:e46015. doi: 10.7554/eLife.46015.
7
Keyword Spotting Using Human Electrocorticographic Recordings.利用人类皮层脑电图记录进行关键词识别
Front Neurosci. 2019 Feb 19;13:60. doi: 10.3389/fnins.2019.00060. eCollection 2019.
8
Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids.利用高密度 ECoG 网格从感觉运动皮层解码口语音素。
Neuroimage. 2018 Oct 15;180(Pt A):301-311. doi: 10.1016/j.neuroimage.2017.10.011. Epub 2017 Oct 7.