Li Qingqing, Wu Qiong, Yu Yiyang, Wu Fengxia, Takahashi Satoshi, Ejima Yoshimichi, Yang Jiajia, Wu Jinglong
Cognitive Neuroscience Laboratory, Graduate School of Natural Science and Technology, Okayama University, Okayama, Japan.
Department of Psychology, Suzhou University of Science and Technology, Suzhou, China.
Iperception. 2020 Dec 31;11(6):2041669520981096. doi: 10.1177/2041669520981096. eCollection 2020 Nov-Dec.
Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge regarding how semantic congruency interacts with attentional load to influence the AV integration of common objects is limited. We investigated these questions by examining AV integration under various attentional-load conditions. AV integration was assessed by adopting an animal identification task using unisensory (animal images and sounds) and AV stimuli (semantically congruent AV objects and semantically incongruent AV objects), while attentional load was manipulated by using a rapid serial visual presentation task. Our results indicate that attentional load did not attenuate the integration of semantically congruent AV objects. However, semantically incongruent animal sounds and images were not integrated (as there was no multisensory facilitation), and the interference effect produced by the semantically incongruent AV objects was reduced by increased attentional-load manipulations. These findings highlight the critical role of semantic congruency in modulating the effect of attentional load on the AV integration of common objects.
注意过程在整合来自不同感觉模态的输入方面发挥着复杂且多方面的作用。然而，注意力负荷增加是否会干扰涉及语义内容的常见物体的视听（AV）整合仍不清楚。此外，关于语义一致性如何与注意力负荷相互作用以影响常见物体的AV整合的知识有限。我们通过在各种注意力负荷条件下检查AV整合来研究这些问题。通过采用动物识别任务来评估AV整合，该任务使用单感觉（动物图像和声音）和AV刺激（语义一致的AV物体和语义不一致的AV物体），同时通过使用快速序列视觉呈现任务来操纵注意力负荷。我们的结果表明，注意力负荷并未减弱语义一致的AV物体的整合。然而，语义不一致的动物声音和图像未被整合（因为没有多感觉促进作用），并且语义不一致的AV物体产生的干扰效应通过增加注意力负荷操纵而降低。这些发现突出了语义一致性在调节注意力负荷对常见物体的AV整合的影响方面的关键作用。
