Department of Psychology, University of New Mexico, Albuquerque, New Mexico, USA.
Psychophysiology. 2017 Dec;54(12):1812-1825. doi: 10.1111/psyp.12959. Epub 2017 Jul 20.
Emotion is an emergent construct of multiple distinct neural processes. EEG is uniquely sensitive to real-time neural computations, and thus is a promising tool to study the construction of emotion. This series of studies aimed to probe the mechanistic contribution of the late positive potential (LPP) to multimodal emotion perception. Experiment 1 revealed that LPP amplitudes for visual images, sounds, and visual images paired with sounds were larger for negatively rated stimuli than for neutrally rated stimuli. Experiment 2 manipulated this audiovisual enhancement by altering the valence pairings with congruent (e.g., positive audio + positive visual) or conflicting emotional pairs (e.g., positive audio + negative visual). Negative visual stimuli evoked larger early LPP amplitudes than positive visual stimuli, regardless of sound pairing. However, time frequency analyses revealed significant midfrontal theta-band power differences for conflicting over congruent stimuli pairs, suggesting very early (∼500 ms) realization of thematic fidelity violations. Interestingly, late LPP modulations were reflective of the opposite pattern of congruency, whereby congruent over conflicting pairs had larger LPP amplitudes. Together, these findings suggest that enhanced parietal activity for affective valence is modality independent and sensitive to complex affective processes. Furthermore, these findings suggest that altered neural activities for affective visual stimuli are enhanced by concurrent affective sounds, paving the way toward an understanding of the construction of multimodal affective experience.
情绪是多种不同神经过程的涌现性构建。脑电图(EEG)对实时神经计算具有独特的敏感性,因此是研究情绪构建的有前途的工具。这一系列研究旨在探究晚期正电位(LPP)对多模态情绪感知的机制贡献。实验 1 表明,与中性评价刺激相比,视觉图像、声音以及与声音配对的视觉图像的负性评价刺激的 LPP 振幅更大。实验 2 通过改变与一致(例如,正性音频+正性视觉)或冲突性情绪对(例如,正性音频+负性视觉)的效价配对,操纵了这种视听增强。无论声音配对如何,负性视觉刺激都引起比正性视觉刺激更大的早期 LPP 振幅。然而,时频分析揭示了冲突性刺激对相对于一致性刺激对的中额theta 波段功率差异,表明主题保真度违反非常早(约 500ms)就被实现。有趣的是,晚期 LPP 调制反映了一致性的相反模式,即一致性刺激对的 LPP 振幅大于冲突性刺激对。总之,这些发现表明,对情感效价的增强顶叶活动是独立于模态的,并对复杂的情感过程敏感。此外,这些发现表明,情感视觉刺激的神经活动改变是由同时的情感声音增强的,为理解多模态情感体验的构建铺平了道路。