Abel Mary Kathryn, Li H Charles, Russo Frank A, Schlaug Gottfried, Loui Psyche
Harvard College, Cambridge, Massachusetts, United States of America.
Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, United States of America.
PLoS One. 2016 Oct 19;11(10):e0163589. doi: 10.1371/journal.pone.0163589. eCollection 2016.
Although pitch is a fundamental attribute of auditory perception, substantial individual differences exist in our ability to perceive differences in pitch. Little is known about how these individual differences in the auditory modality might affect crossmodal processes such as audiovisual perception. In this study, we asked whether individual differences in pitch perception might affect audiovisual perception, as it relates to age of onset and number of years of musical training. Fifty-seven subjects made subjective ratings of interval size when given point-light displays of audio, visual, and audiovisual stimuli of sung intervals. Audiovisual stimuli were divided into congruent and incongruent (audiovisual-mismatched) stimuli. Participants' ratings correlated strongly with interval size in audio-only, visual-only, and audiovisual-congruent conditions. In the audiovisual-incongruent condition, ratings correlated more with audio than with visual stimuli, particularly for subjects who had better pitch perception abilities and higher nonverbal IQ scores. To further investigate the effects of age of onset and length of musical training, subjects were divided into musically trained and untrained groups. Results showed that among subjects with musical training, the degree to which participants' ratings correlated with auditory interval size during incongruent audiovisual perception was correlated with both nonverbal IQ and age of onset of musical training. After partialing out nonverbal IQ, pitch discrimination thresholds were no longer associated with incongruent audio scores, whereas age of onset of musical training remained associated with incongruent audio scores. These findings invite future research on the developmental effects of musical training, particularly those relating to the process of audiovisual perception.
尽管音高是听觉感知的一个基本属性,但我们在感知音高差异的能力上存在很大的个体差异。对于听觉模态中的这些个体差异如何影响视听感知等跨模态过程,我们知之甚少。在本研究中,我们探讨了音高感知的个体差异是否会影响视听感知,这与音乐训练的起始年龄和训练年限有关。57名受试者在观看歌唱音程的音频、视觉和视听刺激的点光显示时,对音程大小进行主观评分。视听刺激分为一致和不一致(视听不匹配)刺激。在仅音频、仅视觉和视听一致的条件下,参与者的评分与音程大小密切相关。在视听不一致的条件下,评分与音频的相关性高于与视觉刺激的相关性,特别是对于那些具有更好音高感知能力和更高非言语智商分数的受试者。为了进一步研究音乐训练的起始年龄和训练时长的影响,受试者被分为受过音乐训练和未受过音乐训练的组。结果表明,在受过音乐训练的受试者中,在不一致的视听感知过程中,参与者评分与听觉音程大小的相关程度与非言语智商和音乐训练的起始年龄均相关。在排除非言语智商的影响后,音高辨别阈值不再与不一致的音频分数相关,而音乐训练的起始年龄仍与不一致的音频分数相关。这些发现为未来关于音乐训练的发展影响的研究,特别是与视听感知过程相关的研究,提供了方向。