Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.
Psychon Bull Rev. 2010 Jun;17(3):323-8. doi: 10.3758/PBR.17.3.323.
When listening to speech, we often benefit when also seeing the speaker's face. If this advantage is not domain specific for speech, the recognition of sung lyrics should also benefit from seeing the singer's face. By independently varying the sight and sound of the lyrics, we found a substantial comprehension benefit of seeing a singer. This benefit was robust across participants, lyrics, and repetition of the test materials. This benefit was much larger than the benefit for sung lyrics obtained in previous research, which had not provided the visual information normally present in singing. Given that the comprehension of sung lyrics benefits from seeing the singer, just like speech comprehension benefits from seeing the speaker, both speech and music perception appear to be multisensory processes.
当我们听演讲时,通常会受益于看到演讲者的面部表情。如果这种优势不是特定于演讲领域的,那么识别歌词也应该受益于看到歌手的面部表情。通过独立地改变歌词的视觉和听觉信息,我们发现看到歌手的存在会对歌词的理解有很大的帮助。这种好处在参与者、歌词和测试材料的重复中都很显著。这种好处比之前研究中通过提供通常在唱歌中存在的视觉信息来获取的歌词理解的好处要大得多。鉴于歌词理解受益于看到歌手,就像演讲理解受益于看到演讲者一样,言语和音乐感知似乎都是多感官的过程。