Williams Jamal R, Markov Yuri A, Tiurina Natalia A, Störmer Viola S
Department of Psychology, University of California San Diego.
Laboratory of Psychophysics, Brain Mind Institute, Ecole Polytechnique Federale de Lausanne (EPFL).
Psychol Sci. 2022 Dec;33(12):2109-2122. doi: 10.1177/09567976221121348. Epub 2022 Sep 30.
Visual object recognition is not performed in isolation but depends on prior knowledge and context. Here, we found that auditory context plays a critical role in visual object perception. Using a psychophysical task in which naturalistic sounds were paired with noisy visual inputs, we demonstrated across two experiments (young adults; s = 18-40 in Experiments 1 and 2, respectively) that the representations of ambiguous visual objects were shifted toward the visual features of an object that were related to the incidental sound. In a series of control experiments, we found that these effects were not driven by decision or response biases (s = 40-85) nor were they due to top-down expectations ( = 40). Instead, these effects were driven by the continuous integration of audiovisual inputs during perception itself. Together, our results demonstrate that the perceptual experience of visual objects is directly shaped by naturalistic auditory context, which provides independent and diagnostic information about the visual world.
视觉物体识别并非孤立进行，而是依赖于先验知识和背景。在此，我们发现听觉背景在视觉物体感知中起着关键作用。通过一项心理物理学任务，其中自然声音与嘈杂的视觉输入配对，我们在两项实验中（分别为年轻人；实验1和2中的s = 18 - 40）证明，模糊视觉物体的表征会朝着与偶然声音相关的物体视觉特征偏移。在一系列对照实验中，我们发现这些效应不是由决策或反应偏差驱动的（s = 40 - 85），也不是由于自上而下的预期（s = 40）。相反，这些效应是由感知过程中视听输入的持续整合驱动的。总之，我们的结果表明，视觉物体的感知体验直接受到自然听觉背景的塑造，自然听觉背景提供了关于视觉世界的独立且具有诊断性的信息。
