Mishra Ramesh Kumar, Marmolejo-Ramos Fernando
Centre for Behavioural and Cognitive Science, The University of Allahabad, Psychology building, Allahabad 211002, India.
Cogn Process. 2010 Nov;11(4):295-305. doi: 10.1007/s10339-010-0363-y. Epub 2010 May 6.
The interaction between vision and language processing is clearly of interest to both cognitive psychologists and psycholinguists. Recent research has begun to create understanding of the interaction between vision and language in terms of the representational issues involved. In this paper, we first review some of the theoretical and methodological issues in the current vision-language interaction debate. Later, we develop a model that attempts to account for effects of affordances and visual context on language-scene interaction as well as the role of sensorimotor simulation. The paper addresses theoretical issues related to the mental representations that arise when visual and linguistic systems interact.
视觉与语言处理之间的相互作用显然引起了认知心理学家和心理语言学家的兴趣。最近的研究已开始从所涉及的表征问题方面来理解视觉与语言之间的相互作用。在本文中,我们首先回顾当前视觉 - 语言相互作用辩论中的一些理论和方法问题。之后,我们构建一个模型,该模型试图解释可供性和视觉语境对语言 - 场景相互作用的影响以及感觉运动模拟的作用。本文探讨了与视觉和语言系统相互作用时产生的心理表征相关的理论问题。