SensoriMotor, Affective and Social Development Laboratory, Faculty of Psychology and Educational Sciences, Universty of Geneva, Geneva, Switzerland.
Swiss Center for Affective Sciences, Campus Biotech, University of Geneva, Geneva, Switzerland.
PLoS One. 2018 Apr 11;13(4):e0194579. doi: 10.1371/journal.pone.0194579. eCollection 2018.
The present study examined whether 6-month-old infants could transfer amodal information (i.e. independently of sensory modalities) from emotional voices to emotional faces. Thus, sequences of successive emotional stimuli (voice or face from one sensory modality -auditory- to another sensory modality -visual-), corresponding to a cross-modal transfer, were displayed to 24 infants. Each sequence presented an emotional (angry or happy) or neutral voice, uniquely, followed by the simultaneous presentation of two static emotional faces (angry or happy, congruous or incongruous with the emotional voice). Eye movements in response to the visual stimuli were recorded with an eye-tracker. First, results suggested no difference in infants' looking time to happy or angry face after listening to the neutral voice or the angry voice. Nevertheless, after listening to the happy voice, infants looked longer at the incongruent angry face (the mouth area in particular) than the congruent happy face. These results revealed that a cross-modal transfer (from auditory to visual modalities) is possible for 6-month-old infants only after the presentation of a happy voice, suggesting that they recognize this emotion amodally.
本研究考察了 6 个月大的婴儿是否能够将模态信息(即独立于感觉模态)从情感声音转移到情感面孔。因此,向 24 名婴儿展示了连续的情感刺激序列(来自一种感觉模态(听觉)到另一种感觉模态(视觉)的声音或面孔),对应于跨模态转移。每个序列呈现一个独特的情感(愤怒或快乐)或中性声音,随后同时呈现两个静态情感面孔(愤怒或快乐,与情感声音一致或不一致)。使用眼动追踪仪记录了对视觉刺激的眼动。首先,结果表明,在听了中性声音或愤怒声音后,婴儿在听到快乐声音后,对不一致的愤怒面孔(特别是嘴巴区域)的注视时间长于一致的快乐面孔。这些结果表明,只有在呈现快乐声音后,6 个月大的婴儿才能进行跨模态转移(从听觉模态到视觉模态),这表明他们可以以非模态方式识别这种情绪。