Department of Psychology, Renmin University of China, Beijing, China.
Department of Psychology, Renmin University of China, Beijing, China; School of foreign languages, Renmin University of China, Beijing, China.
Int J Psychophysiol. 2024 Sep;203:112414. doi: 10.1016/j.ijpsycho.2024.112414. Epub 2024 Aug 10.
In the present study, we aimed to investigate whether long-term music training could improve audio-visual speech integration in Chinese, using event-related brain potential (ERP) measurements. Specifically, we recruited musicians and non-musicians to participate in our experiment where visual Chinese characters were presented simultaneously with congruent or incongruent speech sounds. In order to maintain participants' focus on both auditory and visual modalities, they were instructed to perform a probe detection task. Our study revealed that for the musicians, audiovisual incongruent stimuli elicited larger N1 and N400 amplitudes compared to audiovisual congruent stimuli. Conversely, for the non-musicians, only a larger N400 amplitude was observed for incongruent stimuli relative to congruent stimuli, without a significant difference in N1 amplitude. Furthermore, correlation analyses indicated that more years of music training was associated with a larger N1 effect for the musicians. These results suggest that musicians were capable of detecting character-speech sound incongruence at an earlier time window compared to non-musicians. Overall, our findings provide compelling evidence that music training is associated with better integration of visual characters and auditory speech sounds in language processing.
在本研究中，我们旨在通过事件相关脑电位（ERP）测量来探究长期音乐训练是否可以改善汉语视听言语整合。具体来说，我们招募了音乐家和非音乐家参与我们的实验，在该实验中同时呈现视觉汉字和一致或不一致的语音。为了使参与者专注于听觉和视觉两种模态，他们被要求执行探针检测任务。我们的研究表明，对于音乐家来说，视听不一致刺激引发的 N1 和 N400 振幅大于视听一致刺激。相反，对于非音乐家来说，只有在视听不一致刺激下才会观察到更大的 N400 振幅，而 N1 振幅没有显著差异。此外，相关分析表明，音乐家的音乐训练年限与更大的 N1 效应相关。这些结果表明，与非音乐家相比，音乐家能够在更早的时间窗口检测到字符-语音声音的不一致。总的来说，我们的研究结果提供了令人信服的证据，表明音乐训练与语言处理中视觉字符和听觉语音声音的更好整合有关。
