• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

卷积神经网络可以识别解码空间听觉注意力涉及的大脑交互。

Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention.

机构信息

Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.

RheinMain University of Applied Sciences Campus Ruesselsheim, Wiesbaden, Germany.

出版信息

PLoS Comput Biol. 2024 Aug 8;20(8):e1012376. doi: 10.1371/journal.pcbi.1012376. eCollection 2024 Aug.

DOI:10.1371/journal.pcbi.1012376
PMID:39116183
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11335149/
Abstract

Human listeners have the ability to direct their attention to a single speaker in a multi-talker environment. The neural correlates of selective attention can be decoded from a single trial of electroencephalography (EEG) data. In this study, leveraging the source-reconstructed and anatomically-resolved EEG data as inputs, we sought to employ CNN as an interpretable model to uncover task-specific interactions between brain regions, rather than simply to utilize it as a black box decoder. To this end, our CNN model was specifically designed to learn pairwise interaction representations for 10 cortical regions from five-second inputs. By exclusively utilizing these features for decoding, our model was able to attain a median accuracy of 77.56% for within-participant and 65.14% for cross-participant classification. Through ablation analysis together with dissecting the features of the models and applying cluster analysis, we were able to discern the presence of alpha-band-dominated inter-hemisphere interactions, as well as alpha- and beta-band dominant interactions that were either hemisphere-specific or were characterized by a contrasting pattern between the right and left hemispheres. These interactions were more pronounced in parietal and central regions for within-participant decoding, but in parietal, central, and partly frontal regions for cross-participant decoding. These findings demonstrate that our CNN model can effectively utilize features known to be important in auditory attention tasks and suggest that the application of domain knowledge inspired CNNs on source-reconstructed EEG data can offer a novel computational framework for studying task-relevant brain interactions.

摘要

人类听众在多说话者环境中能够将注意力集中在单个说话者身上。选择性注意的神经相关物可以从单个脑电图 (EEG) 数据试验中解码。在这项研究中,利用源重建和解剖分辨率 EEG 数据作为输入,我们试图使用 CNN 作为可解释模型来揭示大脑区域之间特定于任务的相互作用,而不仅仅是将其用作黑盒解码器。为此,我们的 CNN 模型专门设计用于从五秒的输入中学习 10 个皮质区域的成对交互表示。通过仅将这些特征用于解码,我们的模型能够在参与者内达到 77.56%的中位数准确率,在跨参与者分类中达到 65.14%的中位数准确率。通过消融分析以及对模型特征的剖析和应用聚类分析,我们能够辨别出以 alpha 波段为主的半球间相互作用的存在,以及以 alpha 和 beta 波段为主的半球特异性相互作用或在左右半球之间呈现对比模式的相互作用。这些相互作用在参与者内解码时更为明显于顶叶和中央区域,但在跨参与者解码时更明显于顶叶、中央和部分额叶区域。这些发现表明,我们的 CNN 模型可以有效地利用已知在听觉注意力任务中很重要的特征,并表明在源重建 EEG 数据上应用受领域知识启发的 CNN 可以为研究与任务相关的大脑相互作用提供新的计算框架。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/f00d943b2da5/pcbi.1012376.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/5d14648c3194/pcbi.1012376.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/825b7566aaba/pcbi.1012376.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/5e465624b40c/pcbi.1012376.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/f00d943b2da5/pcbi.1012376.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/5d14648c3194/pcbi.1012376.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/825b7566aaba/pcbi.1012376.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/5e465624b40c/pcbi.1012376.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fdbc/11335149/f00d943b2da5/pcbi.1012376.g004.jpg

相似文献

1
Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention.卷积神经网络可以识别解码空间听觉注意力涉及的大脑交互。
PLoS Comput Biol. 2024 Aug 8;20(8):e1012376. doi: 10.1371/journal.pcbi.1012376. eCollection 2024 Aug.
2
Convolutional neural networks for decoding of covert attention focus and saliency maps for EEG feature visualization.卷积神经网络用于解码隐蔽注意力焦点和 EEG 特征可视化的显着性图。
J Neural Eng. 2019 Oct 23;16(6):066010. doi: 10.1088/1741-2552/ab3bb4.
3
fMRI volume classification using a 3D convolutional neural network robust to shifted and scaled neuronal activations.使用对移位和缩放神经元激活具有鲁棒性的 3D 卷积神经网络进行 fMRI 体积分类。
Neuroimage. 2020 Dec;223:117328. doi: 10.1016/j.neuroimage.2020.117328. Epub 2020 Sep 5.
4
Deep learning-based auditory attention decoding in listeners with hearing impairment.基于深度学习的听力受损者听觉注意力解码
J Neural Eng. 2024 May 22;21(3). doi: 10.1088/1741-2552/ad49d7.
5
EEG-based auditory attention detection: boundary conditions for background noise and speaker positions.基于脑电图的听觉注意力检测:背景噪声和说话人位置的边界条件。
J Neural Eng. 2018 Dec;15(6):066017. doi: 10.1088/1741-2552/aae0a6. Epub 2018 Sep 12.
6
Noise-robust cortical tracking of attended speech in real-world acoustic scenes.在真实声学场景中对注意到的语音进行抗噪皮层追踪。
Neuroimage. 2017 Aug 1;156:435-444. doi: 10.1016/j.neuroimage.2017.04.026. Epub 2017 Apr 13.
7
Switching auditory attention using spatial and non-spatial features recruits different cortical networks.利用空间和非空间特征切换听觉注意力会招募不同的皮质网络。
Neuroimage. 2014 Jan 1;84:681-7. doi: 10.1016/j.neuroimage.2013.09.061. Epub 2013 Oct 3.
8
ConTraNet: A hybrid network for improving the classification of EEG and EMG signals with limited training data.ConTraNet:一种混合网络,用于在有限的训练数据下提高 EEG 和 EMG 信号的分类。
Comput Biol Med. 2024 Jan;168:107649. doi: 10.1016/j.compbiomed.2023.107649. Epub 2023 Nov 2.
9
Mapping the spatiotemporal dynamics of processing task-relevant and task-irrelevant sound feature changes using concurrent EEG-fMRI.使用同步脑电图-功能磁共振成像技术绘制处理任务相关和任务无关声音特征变化的时空动态图。
Hum Brain Mapp. 2016 Oct;37(10):3400-16. doi: 10.1002/hbm.23248. Epub 2016 Jun 9.
10
EEG-based auditory attention decoding using speech-level-based segmented computational models.基于脑电的听觉注意解码,使用基于语音分段的计算模型。
J Neural Eng. 2021 May 25;18(4). doi: 10.1088/1741-2552/abfeba.

本文引用的文献

1
EEG motor imagery decoding: a framework for comparative analysis with channel attention mechanisms.脑电运动想象解码:一种基于通道注意力机制的比较分析框架。
J Neural Eng. 2024 May 20;21(3). doi: 10.1088/1741-2552/ad48b9.
2
LGGNet: Learning From Local-Global-Graph Representations for Brain-Computer Interface.LGGNet:基于局部-全局-图表示的脑机接口学习。
IEEE Trans Neural Netw Learn Syst. 2024 Jul;35(7):9773-9786. doi: 10.1109/TNNLS.2023.3236635. Epub 2024 Jul 8.
3
Decoding of the speech envelope from EEG using the VLAAI deep neural network.
使用 VLAAI 深度神经网络对 EEG 进行语音包络解码。
Sci Rep. 2023 Jan 16;13(1):812. doi: 10.1038/s41598-022-27332-2.
4
Robust decoding of the speech envelope from EEG recordings through deep neural networks.通过深度神经网络从 EEG 记录中稳健地解码语音包络。
J Neural Eng. 2022 Jul 6;19(4). doi: 10.1088/1741-2552/ac7976.
5
EEG-based detection of the locus of auditory attention with convolutional neural networks.基于 EEG 的卷积神经网络对听觉注意力焦点的检测。
Elife. 2021 Apr 30;10:e56481. doi: 10.7554/eLife.56481.
6
Spatio-Spectral Feature Representation for Motor Imagery Classification Using Convolutional Neural Networks.基于卷积神经网络的运动想象分类的时空频谱特征表示。
IEEE Trans Neural Netw Learn Syst. 2022 Jul;33(7):3038-3049. doi: 10.1109/TNNLS.2020.3048385. Epub 2022 Jul 6.
7
Orienting auditory attention in time: Lateralized alpha power reflects spatio-temporal filtering.定位听觉注意力的时间:偏侧化的 alpha 功率反映了时空滤波。
Neuroimage. 2021 Mar;228:117711. doi: 10.1016/j.neuroimage.2020.117711. Epub 2020 Dec 29.
8
A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers.基于深度学习的非侵入式脑信号研究综述:最新进展与新前沿
J Neural Eng. 2021 Mar 5;18(3). doi: 10.1088/1741-2552/abc902.
9
Auditory attention tracking states in a cocktail party environment can be decoded by deep convolutional neural networks.鸡尾酒会环境中的听觉注意跟踪状态可以通过深度卷积神经网络进行解码。
J Neural Eng. 2020 Jun 12;17(3):036013. doi: 10.1088/1741-2552/ab92b2.
10
EEG based multi-class seizure type classification using convolutional neural network and transfer learning.基于 EEG 的卷积神经网络和迁移学习的多类癫痫类型分类。
Neural Netw. 2020 Apr;124:202-212. doi: 10.1016/j.neunet.2020.01.017. Epub 2020 Jan 25.