Department of Psychology, University of Connecticut Haskins Laboratories, New Haven.
Cogn Sci. 2011 Aug;35(6):1009-51. doi: 10.1111/j.1551-6709.2011.01180.x. Epub 2011 May 24.
The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP.
视觉世界范式（VWP）向听众提出了一个具有挑战性的问题：他们必须整合两种不同的信号，即口语语言和视觉语境，以支持行动（例如，在场景中进行复杂的眼球运动）。我们提出了脉冲处理，这是一种用于视觉世界中眼球运动的动态系统方法，为语言、视觉和行动的综合提供了一个框架。我们的方法假设，由语言和视觉语境驱动的脉冲会细微地影响与系统潜在眼球运动行为相对应的吸引力动态景观。我们在 VWP 的实证研究中检验了我们方法的三个独特预测，并在人工神经网络中描述了其实现。我们讨论了脉冲处理框架与 VWP 的其他模型的关系。
