Wallmark Zachary, Allen Sarah E
School of Music and Dance, University of Oregon, Eugene, OR, USA.
Meadows School of the Arts, Southern Methodist University, Dallas, TX, USA.
Atten Percept Psychophys. 2020 Jul;82(5):2230-2236. doi: 10.3758/s13414-020-02015-0.
Crossmodal correspondences have been of interest to researchers for nearly a century, although it is only more recently that interactions related to timbre have been examined systematically. Timbre is often described using crossmodal adjectives (e.g., bright, smooth). However, it is not clear whether these semantic conventions are primarily the result of low-level multisensory interactions or are more a product of associative learning and musical training. Do young children exhibit crossmodal correspondences involving timbre? The aim of this study was to investigate the effects of timbre, age, and sensory modality (visual and tactile) on the consistency and congruency of young children's patterns of crossmodal mappings. Preschool children (N = 69, M age = 4.51) completed a novel audio-visual and audio-tactile association task. Results indicate that children are moderately consistent in their associations; mappings are largely congruent with adult associations; and results suggest a possible developmental time course for the establishment of crossmodal correspondences between approximately ages 3 and 6. However, congruency is dependent on modality, with robust agreement in the tactile-auditory domain but a good deal more variance and a stronger developmental influence on visual-auditory associations. These results are the first to demonstrate that crossmodal correspondences are a feature of timbre perception early in development.
近一个世纪以来,跨通道对应关系一直是研究人员感兴趣的课题,不过直到最近,与音色相关的相互作用才得到系统研究。音色通常用跨通道形容词来描述(例如,明亮的、柔和的)。然而,尚不清楚这些语义惯例主要是低层次多感官相互作用的结果,还是更多地是联想学习和音乐训练的产物。幼儿是否表现出涉及音色的跨通道对应关系?本研究的目的是调查音色、年龄和感官模态(视觉和触觉)对幼儿跨通道映射模式的一致性和匹配性的影响。学龄前儿童(N = 69,平均年龄 = 4.51岁)完成了一项新颖的视听和听触联想任务。结果表明,儿童在联想方面具有中等程度的一致性;映射在很大程度上与成人的联想相匹配;结果表明在大约3至6岁之间建立跨通道对应关系可能存在一个发展时间进程。然而,匹配性取决于模态,触觉 - 听觉领域有强烈的一致性,但视觉 - 听觉联想方面存在更多差异以及更强的发展影响。这些结果首次证明跨通道对应关系是早期发展中音色感知的一个特征。