Gruber Liron Z, Haruvi Aia, Basri Ronen, Irani Michal
Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel.
Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel.
Front Comput Neurosci. 2018 Jul 24;12:57. doi: 10.3389/fncom.2018.00057. eCollection 2018.
Visual perception involves continuously choosing the most prominent inputs while suppressing others. Neuroscientists induce visual competitions in various ways to study why and how the brain makes choices of what to perceive. Recently deep neural networks (DNNs) have been used as models of the ventral stream of the visual system, due to similarities in both accuracy and hierarchy of feature representation. In this study we created non-dynamic visual competitions for humans by briefly presenting mixtures of two images. We then tested feed-forward DNNs with similar mixtures and examined their behavior. We found that both humans and DNNs tend to perceive only one image when presented with a mixture of two. We revealed image parameters which predict this perceptual dominance and compared their predictability for the two visual systems. Our findings can be used to both improve DNNs as models, as well as potentially improve their performance by imitating biological behaviors.
视觉感知涉及在抑制其他输入的同时持续选择最突出的输入。神经科学家通过各种方式引发视觉竞争,以研究大脑为何以及如何做出感知选择。最近,由于在特征表示的准确性和层次结构方面存在相似性,深度神经网络(DNN)已被用作视觉系统腹侧流的模型。在本研究中,我们通过短暂呈现两张图像的混合图像,为人类创建了非动态视觉竞争。然后,我们用类似的混合图像测试了前馈DNN,并检查了它们的行为。我们发现,当呈现两张图像的混合图像时,人类和DNN都倾向于只感知其中一张图像。我们揭示了预测这种感知优势的图像参数,并比较了它们对两个视觉系统的可预测性。我们的发现可用于改进作为模型的DNN,以及通过模仿生物行为潜在地提高它们的性能。