Janyan Armina, Shtyrov Yury, Andriushchenko Ekaterina, Blinova Ekaterina, Shcherbakova Olga
Research Center for Cognitive Science, New Bulgarian University, Sofia, Bulgaria.
Center of Functionally Integrative Neuroscience, Institute for Clinical Medicine, Aarhus University, Aarhus, Denmark.
Iperception. 2022 May 23;13(3):20416695221095884. doi: 10.1177/20416695221095884. eCollection 2022 May.
One of the unresolved questions in multisensory research is that of automaticity of consistent associations between sensory features from different modalities (e.g. high visual locations associated with high sound pitch). We addressed this issue by examining a possible role of selective attention in the audiovisual correspondence effect. We orthogonally manipulated loudness and pitch, directing participants' attention to the auditory modality only and using pitch and loudness identification tasks. Visual stimuli in high, low or central spatial locations appeared simultaneously with the sounds. If the correspondence effect is automatic, it should not be affected by task changes. The results, however, demonstrated a cross-modal pitch-verticality correspondence effect only when participants' attention was directed to pitch, but not to loudness identification task; moreover, the effect was present only in the upper location. The findings underscore the involvement of selective attention in cross-modal associations and support a top-down account of audiovisual correspondence effects.
多感官研究中尚未解决的问题之一是,来自不同模态的感官特征之间一致关联的自动性问题(例如,高视觉位置与高音调相关联)。我们通过研究选择性注意在视听对应效应中的可能作用来解决这个问题。我们对响度和音高进行了正交操纵,仅将参与者的注意力引导至听觉模态,并使用音高和响度识别任务。高、低或中央空间位置的视觉刺激与声音同时出现。如果对应效应是自动的,那么它不应受任务变化的影响。然而,结果表明,只有当参与者的注意力指向音高而非响度识别任务时,才会出现跨模态的音高-垂直性对应效应;此外,该效应仅出现在上部位置。这些发现强调了选择性注意在跨模态关联中的作用,并支持了对视听对应效应的自上而下的解释。