Thompson L A, Massaro D W
New Mexico State University.
J Exp Child Psychol. 1994 Jun;57(3):327-54. doi: 10.1006/jecp.1994.1016.
We examined 4- and 9-year-old's referential comprehension when given pointing gestures and spoken labels, in two types of contextually ambiguous situations. In one situation, speech/gesture discordance was produced in conditions where labels for one of four objects being referred to sounded either alike, or different from each other. In the other, the contextual set contained the same two objects, and ambiguity was produced by factorially combining speech on a continuum ranging between /bcl/ and /dcl/ with a pointing gesture from a continuum ranging between an unambiguous point to a ball and to a doll. Results showed that the speech modality had a far greater influence on word comprehension than gestures. Second, the influence of gestures was greater for the older children. Mathematical models of speech-gesture understanding were tested against the data. Selection models assume that one dimension of information is used on a given trial, and that the selection of a modality depends on the ambiguity of information encoded on the dominant dimension. The Fuzzy Logical Model of Perception (FLMP) assumes that both modalities are evaluated independently of one another and then integrated to achieve comprehension. The results from both age groups were best described by the assumptions of the FLMP. Results are related to general claims about perceptual development during childhood concerning the quality of representations formed and dimensional selectivity of visual-spoken language.
我们在两种上下文模糊的情境中，研究了4岁和9岁儿童在面对指示性手势和口头标签时的指称理解能力。在一种情境中，当指代四个物体之一的标签发音相似或彼此不同时，会产生言语/手势不一致的情况。在另一种情境中，上下文集合包含相同的两个物体，通过将/bcl/到/dcl/连续范围内的言语与从明确指向球到指向玩偶的连续范围内的指示性手势进行因子组合，产生模糊性。结果表明，言语模态对词汇理解的影响远大于手势。其次，手势对年龄较大儿童的影响更大。针对这些数据测试了言语-手势理解的数学模型。选择模型假设在给定试验中使用信息的一个维度，并且模态的选择取决于主导维度上编码信息的模糊性。感知模糊逻辑模型（FLMP）假设两种模态相互独立评估，然后整合以实现理解。两个年龄组的结果都最符合FLMP的假设。研究结果与关于儿童期感知发展的一般观点相关，这些观点涉及所形成表征的质量以及视觉-口头语言的维度选择性。
