University of Florida, 945 Center Drive, Gainesville, FL 32603, USA.
Psychology Department, University of South Alabama, Mobile, 36688, AL, USA.
Philos Trans R Soc Lond B Biol Sci. 2023 Sep 25;378(1886):20220347. doi: 10.1098/rstb.2022.0347. Epub 2023 Aug 7.
Hundreds (if not thousands) of multisensory studies provide evidence that the human brain can integrate temporally and spatially discrepant stimuli from distinct modalities into a singular event. This process of multisensory integration is usually portrayed in the scientific literature as contributing to our integrated, coherent perceptual reality. However, missing from this account is an answer to a simple question: how do confidence judgements compare between multisensory information that is integrated across multiple sources, and multisensory information that comes from a single, congruent source in the environment? In this paper, we use the sound-induced flash illusion to investigate if confidence judgements are similar across multisensory conditions when the numbers of auditory and visual events are the same, and the numbers of auditory and visual events are different. Results showed that congruent audiovisual stimuli produced higher confidence than incongruent audiovisual stimuli, even when the perceptual report was matched across the two conditions. Integrating these behavioural findings with recent neuroimaging and theoretical work, we discuss the role that prefrontal cortex may play in metacognition, multisensory causal inference and sensory source monitoring in general. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
数百种(如果不是数千种)的多感觉研究提供了证据,证明人类大脑可以将来自不同感觉模态的时间和空间上不协调的刺激整合到一个单一的事件中。多感觉整合的这个过程通常在科学文献中被描绘为有助于我们的综合、连贯的感知现实。然而,这个解释中缺失了一个简单的问题的答案:当来自多个来源的多感觉信息与来自环境中单一、一致的来源的多感觉信息进行整合时,信心判断会如何进行比较?在本文中,我们使用声音诱导的闪光错觉来研究当听觉和视觉事件的数量相同时,以及听觉和视觉事件的数量不同时,多感觉条件下的信心判断是否相似。结果表明,一致的视听刺激比不一致的视听刺激产生更高的信心,即使在两种条件下的感知报告相匹配的情况下也是如此。将这些行为发现与最近的神经影像学和理论工作结合起来,我们讨论了前额叶皮层在元认知、多感觉因果推理和一般的感觉源监测中可能扮演的角色。本文是主题为“多感觉感知中的决策和控制过程”的一部分。