Cognitive Brain Dynamics Lab, National Brain Research Centre, NH8, Manesar, Gurgaon 122052, Haryana, India.
Department of Psychology, Ashoka University, Sonepat 131029, Haryana, India.
Cereb Cortex. 2024 Aug 1;34(8). doi: 10.1093/cercor/bhae323.
Speech perception requires the binding of spatiotemporally disjoint auditory-visual cues. The corresponding brain network-level information processing can be characterized by two complementary mechanisms: functional segregation which refers to the localization of processing in either isolated or distributed modules across the brain, and integration which pertains to cooperation among relevant functional modules. Here, we demonstrate using functional magnetic resonance imaging recordings that subjective perceptual experience of multisensory speech stimuli, real and illusory, are represented in differential states of segregation-integration. We controlled the inter-subject variability of illusory/cross-modal perception parametrically, by introducing temporal lags in the incongruent auditory-visual articulations of speech sounds within the McGurk paradigm. The states of segregation-integration balance were captured using two alternative computational approaches. First, the module responsible for cross-modal binding of sensory signals defined as the perceptual binding network (PBN) was identified using standardized parametric statistical approaches and their temporal correlations with all other brain areas were computed. With increasing illusory perception, the majority of the nodes of PBN showed decreased cooperation with the rest of the brain, reflecting states of high segregation but reduced global integration. Second, using graph theoretic measures, the altered patterns of segregation-integration were cross-validated.
言语感知需要将时空上不连续的视听线索绑定在一起。相应的大脑网络级别的信息处理可以通过两种互补的机制来描述:功能分离,即处理位于大脑中孤立或分布的模块中;以及整合,即相关功能模块之间的合作。在这里,我们使用功能磁共振成像记录证明了多感觉言语刺激的主观感知体验,无论是真实的还是虚幻的,都以分离-整合的不同状态来表示。我们通过在麦格克范式中引入言语声音的不和谐听觉-视觉发音的时间滞后,参数化地控制了虚幻/跨模态感知的个体间可变性。使用两种替代的计算方法来捕捉分离-整合的平衡状态。首先,使用标准化参数统计方法识别负责感觉信号跨模态绑定的模块,即感知绑定网络(PBN),并计算它们与大脑其他区域的时间相关性。随着虚幻感知的增加,PBN 的大多数节点与大脑的其余部分的合作减少,反映出高度分离但整体整合减少的状态。其次,使用图论度量,交叉验证了分离-整合的改变模式。