Department of Psychology and Cognitive Science Program, Indiana UniversityDepartment of Computer Science, University of RochesterDepartment of Brain and Cognitive Sciences, University of Rochester.
Cogn Sci. 2005 Nov 12;29(6):961-1005. doi: 10.1207/s15516709cog0000_40.
We examine the influence of inferring interlocutors' referential intentions from their body movements at the early stage of lexical acquisition. By testing human participants and comparing their performances in different learning conditions, we find that those embodied intentions facilitate both word discovery and word-meaning association. In light of empirical findings, the main part of this article presents a computational model that can identify the sound patterns of individual words from continuous speech, using nonlinguistic contextual information, and employ body movements as deictic references to discover word-meaning associations. To our knowledge, this work is the first model of word learning that not only learns lexical items from raw multisensory signals to closely resemble infant language development from natural environments, but also explores the computational role of social cognitive skills in lexical acquisition.
我们考察了在词汇习得的早期阶段,从对方的身体动作中推断出其指称意图对语言学习的影响。通过测试人类参与者并比较他们在不同学习条件下的表现,我们发现这些具身意图有助于单词的发现和词义联想。本文的主要部分基于实证研究结果,提出了一个计算模型,该模型可以使用非语言语境信息从连续语音中识别单个单词的声音模式,并利用身体动作作为指示参考来发现单词的词义关联。据我们所知,这项工作是第一个不仅从原始多感官信号中学习词汇项以紧密模仿自然环境中婴儿语言发展,而且还探索社会认知技能在词汇习得中计算作用的单词学习模型。