Wallraven Christian, Bülthoff Heinrich H, Waterkamp Steffen, van Dam Loes, Gaissert Nina
Department of Brain and Cognitive Engineering, Korea University, Anam-Dong 5ga, Seongbuk-gu, Seoul, 136-713, Korea,
Psychon Bull Rev. 2014 Aug;21(4):976-85. doi: 10.3758/s13423-013-0563-4.
Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.
对所见物体的分类通常由物体的形状决定。然而,形状并非视觉模态所独有:触觉系统在识别形状方面也很在行。因此,理解形状处理的一个重要问题是,人类是存储独立的模态依赖形状表征,还是将信息整合到一个多感官表征中。为了回答这个问题,我们创建了一个由形状各异的计算机生成的新颖物体组成的度量空间。然后使用3D打印机打印这些物体,以生成可触摸的刺激物。在一个分类实验中,参与者首先通过视觉和触觉探索这些物体。我们发现两种模态都导致了高度相似的分类行为。接下来,参与者在度量空间内对形状类别进行视觉或触觉训练。不出所料,视觉训练提高了视觉表现,触觉训练提高了触觉表现。然而,重要的是,我们发现视觉训练也提高了触觉表现,反之亦然。另外两个实验表明,度量空间中类别边界的位置也会跨模态转移,与边界相邻物体的更高辨别力也是如此。这种观察到的跨模态度量类别知识转移表明,视觉和触觉形式的形状信息被整合到一个共享的多感官表征中。