Csonka Matt, Mardmomen Nadia, Webster Paula J, Brefczynski-Lewis Julie A, Frum Chris, Lewis James W
Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University, Morgantown, WV 26506, USA.
Cereb Cortex Commun. 2021 Jan 18;2(1):tgab002. doi: 10.1093/texcom/tgab002. eCollection 2021.
Our ability to perceive meaningful action events involving objects, people, and other animate agents is characterized in part by an interplay of visual and auditory sensory processing and their cross-modal interactions. However, this multisensory ability can be altered or dysfunctional in some hearing and sighted individuals, and in some clinical populations. The present meta-analysis sought to test current hypotheses regarding neurobiological architectures that may mediate audio-visual multisensory processing. Reported coordinates from 82 neuroimaging studies (137 experiments) that revealed some form of audio-visual interaction in discrete brain regions were compiled, converted to a common coordinate space, and then organized along specific categorical dimensions to generate activation likelihood estimate (ALE) brain maps and various contrasts of those derived maps. The results revealed brain regions (cortical "hubs") preferentially involved in multisensory processing along different stimulus category dimensions, including 1) living versus nonliving audio-visual events, 2) audio-visual events involving vocalizations versus actions by living sources, 3) emotionally valent events, and 4) dynamic-visual versus static-visual audio-visual stimuli. These meta-analysis results are discussed in the context of neurocomputational theories of semantic knowledge representations and perception, and the brain volumes of interest are available for download to facilitate data interpretation for future neuroimaging studies.
我们感知涉及物体、人物和其他有生命主体的有意义动作事件的能力，部分特征在于视觉和听觉感官处理及其跨模态交互的相互作用。然而，这种多感官能力在一些听力正常和视力正常的个体以及一些临床人群中可能会发生改变或功能失调。本荟萃分析旨在检验当前关于可能介导视听多感官处理的神经生物学结构的假设。我们汇总了82项神经影像学研究（137项实验）报告的坐标，这些研究揭示了离散脑区中某种形式的视听交互，将其转换为共同的坐标空间，然后沿着特定的分类维度进行组织，以生成激活似然估计（ALE）脑图谱以及这些衍生图谱的各种对比。结果揭示了在不同刺激类别维度上优先参与多感官处理的脑区（皮质“枢纽”），包括1）有生命与无生命的视听事件，2）涉及发声与有生命来源动作的视听事件，3）具有情感效价的事件，以及4）动态视觉与静态视觉的视听刺激。我们在语义知识表征和感知的神经计算理论背景下讨论了这些荟萃分析结果，感兴趣的脑区体积可供下载，以方便未来神经影像学研究的数据解读。
