Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK.
Centre for Sensory Studies, Concordia University, Montréal, Canada.
Nat Commun. 2020 Oct 28;11(1):5440. doi: 10.1038/s41467-020-19306-7.
Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., 'Early') processing benefits or post-sensory (i.e., 'Late') changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas.
尽管人们在理解多感觉决策方面最近取得了进展,但对于大脑如何将相关证据转化为决策,还缺乏一个明确的机械解释。具体来说,目前尚不清楚在快速多感觉决策过程中感知能力的提高是最好地通过感觉(即“早期”)处理益处来解释,还是通过感觉后的(即“晚期”)决策动态变化来解释。在这里,我们使用了一种成熟的视觉物体分类任务,该任务可以通过对脑电图(EEG)的多元模式分析来分离早期感觉和感觉后的决策证据。我们利用这些不同的神经成分来确定何时以及如何互补的听觉信息在多感觉环境中影响决策相关视觉证据的编码。我们表明,在快速视听决策过程中,被放大的主要是感觉后的而不是早期的 EEG 成分幅度。我们使用一个受神经启发的漂移扩散模型表明,准确性的多感觉行为改善来自于相关决策证据质量的提高,这种提高可以通过感觉后的 EEG 成分来捕捉,这与多感觉证据在大脑更高层次区域的出现是一致的。