Li Yueying, Li Zimo, Deng Aihui, Zheng Hewu, Chen Jianxin, Ren Yanna, Yang Weiping
Department of Psychology, Faculty of Education, Hubei University, Wuhan, China; Graduate School of Humanities, Kobe University, Japan.
Department of Psychology, Faculty of Education, Hubei University, Wuhan, China.
Iperception. 2021 May 27;12(3):20416695211018714. doi: 10.1177/20416695211018714. eCollection 2021 May-Jun.
Although emotional audiovisual integration has been investigated previously, whether emotional audiovisual integration is affected by the spatial allocation of visual attention is currently unknown. To examine this question, a variant of the exogenous spatial cueing paradigm was adopted, in which stimuli varying by facial expressions and nonverbal affective prosody were used to express six basic emotions (happiness, anger, disgust, sadness, fear, surprise) via a visual, an auditory, or an audiovisual modality. The emotional stimuli were preceded by an unpredictive cue that was used to attract participants' visual attention. The results showed significantly higher accuracy and quicker response times in response to bimodal audiovisual stimuli than to unimodal visual or auditory stimuli for emotional perception under both valid and invalid cue conditions. The auditory facilitation effect was stronger than the visual facilitation effect under exogenous attention for the six emotions tested. Larger auditory enhancement was induced when the target was presented at the expected location than at the unexpected location. For emotional perception, happiness shared the biggest auditory enhancement among all six emotions. However, the influence of exogenous cueing effect on emotional perception seemed to be absent.
尽管先前已经对情绪视听整合进行了研究,但情绪视听整合是否受视觉注意力的空间分配影响目前尚不清楚。为了探究这个问题,采用了一种外源性空间线索范式的变体,其中通过视觉、听觉或视听模态,使用面部表情和非言语情感韵律变化的刺激来表达六种基本情绪(快乐、愤怒、厌恶、悲伤、恐惧、惊讶)。情绪刺激之前会出现一个不可预测的线索,用于吸引参与者的视觉注意力。结果表明,在有效和无效线索条件下,对于情绪感知,与单峰视觉或听觉刺激相比,对双峰视听刺激的反应准确率显著更高,反应时间更快。在所测试的六种情绪中,在外源性注意力条件下,听觉促进效应强于视觉促进效应。当目标出现在预期位置时比出现在意外位置时诱发的听觉增强更大。对于情绪感知,快乐在所有六种情绪中共享最大的听觉增强。然而,外源性线索效应似乎对情绪感知没有影响。