Niimi Ryosuke, Saiki Takahiro, Yokosawa Kazuhiko
Faculty of Humanities, Niigata University, Niigata, Japan.
Department of Psychology, The University of Tokyo, Tokyo, Japan.
Atten Percept Psychophys. 2023 May;85(4):1267-1275. doi: 10.3758/s13414-023-02699-0. Epub 2023 Mar 28.
Visual object recognition is facilitated by contextually consistent scenes in which the object is embedded. Scene gist representations extracted from the scenery backgrounds yield this scene consistency effect. Here we examined whether the scene consistency effect is specific to the visual domain or if it is crossmodal. Through four experiments, the accuracy of the naming of briefly presented visual objects was assessed. In each trial, a 4-s sound clip was presented and a visual scene containing the target object was briefly shown at the end of the sound clip. In a consistent sound condition, an environmental sound associated with the scene in which the target object typically appears was presented (e.g., forest noise for a bear target object). In an inconsistent sound condition, a sound clip contextually inconsistent with the target object was presented (e.g., city noise for a bear). In a control sound condition, a nonsensical sound (sawtooth wave) was presented. When target objects were embedded in contextually consistent visual scenes (Experiment 1: a bear in a forest background), consistent sounds increased object-naming accuracy. In contrast, sound conditions did not show a significant effect when target objects were embedded in contextually inconsistent visual scenes (Experiment 2: a bear in a pedestrian crossing background) or in a blank background (Experiments 3 and 4). These results suggested that auditory scene context has weak or no direct influence on visual object recognition. It seems likely that consistent auditory scenes indirectly facilitate visual object recognition by promoting visual scene processing.
视觉对象识别会因对象所处的上下文一致的场景而得到促进。从场景背景中提取的场景主旨表征产生了这种场景一致性效应。在这里,我们研究了场景一致性效应是否特定于视觉领域,或者它是否是跨模态的。通过四项实验,评估了对短暂呈现的视觉对象进行命名的准确性。在每次试验中,先呈现一段4秒的声音片段,然后在声音片段结束时短暂展示一个包含目标对象的视觉场景。在一致声音条件下,呈现与目标对象通常出现的场景相关的环境声音(例如,对于熊目标对象,呈现森林噪音)。在不一致声音条件下,呈现与目标对象上下文不一致的声音片段(例如,对于熊,呈现城市噪音)。在控制声音条件下,呈现无意义的声音(锯齿波)。当目标对象嵌入上下文一致的视觉场景中时(实验1:森林背景中的熊),一致的声音提高了对象命名的准确性。相比之下,当目标对象嵌入上下文不一致的视觉场景中时(实验2:人行横道背景中的熊)或在空白背景中时(实验3和4),声音条件没有显示出显著影响。这些结果表明,听觉场景上下文对视觉对象识别的直接影响较弱或没有直接影响。一致的听觉场景似乎可能通过促进视觉场景处理来间接促进视觉对象识别。