Shen Yang-Chen, Chen Yi-Chuan, Huang Pi-Chun
Department of Psychology, National Cheng Kung University, Tainan.
Department of Medicine, Mackay Medical College, New Taipei City.
Iperception. 2022 Mar 16;13(2):20416695221084724. doi: 10.1177/20416695221084724. eCollection 2022 Mar-Apr.
Crossmodal correspondences refer to the fact that certain domains of features in different sensory modalities are associated with each other. Here, we investigated the crossmodal correspondences between speech sounds and visual shapes. Specifically, we tested whether the classification dimensions of English vowels (front-central-back) and consonants (voiced-voiceless, sonorant-obstruent, and stop-continuant) correspond to visual shapes along a bipolar rounded-angular dimension. We adapted eighteen meaningless pseudowords from a previous study that corresponded to either the round or the sharp concept. On each trial, the participants heard one of the pseudowords and saw a rounded shape and an angular shape presented side-by-side on the monitor. Participants judged which shape provided a better match to the spoken pseudoword. A logistic regression was conducted in order to elucidate the effectiveness of classification dimensions of phonemes when predicting variations in the sound-shape matchings. The results demonstrated that the sound-shape matchings were predictable using front-central-back dimensions of vowels, and voiced-voiceless and stop-continuant dimensions of consonants. Hence, we verified that sound-shape matching is underpinned by contrasting dimensions in both vowels and consonants, therefore demonstrating crossmodal correspondences at the phonetic level.
跨通道对应指的是不同感官模态中的某些特征域相互关联这一事实。在此，我们研究了语音和视觉形状之间的跨通道对应。具体而言，我们测试了英语元音的分类维度（前-中-后）和辅音的分类维度（浊音-清音、响音-阻塞音以及塞音-擦音）是否沿着双极的圆-角维度与视觉形状相对应。我们从之前的一项研究中改编了18个无意义的假词，这些假词分别对应圆或尖的概念。在每次试验中，参与者会听到其中一个假词，并在显示器上看到一个圆形和一个角形并排呈现。参与者判断哪个形状与所读的假词更匹配。进行了逻辑回归分析，以阐明音素分类维度在预测声音-形状匹配变化时的有效性。结果表明，使用元音的前-中-后维度以及辅音的浊音-清音和塞音-擦音维度可以预测声音-形状匹配。因此，我们证实了声音-形状匹配是由元音和辅音中的对比维度所支撑的，从而在语音层面证明了跨通道对应。
