Research and Development Initiative, Chuo University, 1-13-27, Kasuga, Bunkyo-ku, Tokyo, JP112-8551, Japan.
Department of Information Science and Biomedical Engineering, Kagoshima University, 1-21-40 Korimoto, Kagoshima, 890-0065, Japan.
Sci Rep. 2018 Jun 18;8(1):9301. doi: 10.1038/s41598-018-27153-2.
The human perceptual system enables us to extract visual properties of an object's material from auditory information. In monkeys, the neural basis underlying such multisensory association develops through experience of exposure to a material; material information could be processed in the posterior inferior temporal cortex, progressively from the high-order visual areas. In humans, however, the development of this neural representation remains poorly understood. Here, we demonstrated for the first time the presence of a mapping of the auditory material property with visual material ("Metal" and "Wood") in the right temporal region in preverbal 4- to 8-month-old infants, using near-infrared spectroscopy (NIRS). Furthermore, we found that infants acquired the audio-visual mapping for a property of the "Metal" material later than for the "Wood" material, since infants form the visual property of "Metal" material after approximately 6 months of age. These findings indicate that multisensory processing of material information induces the activation of brain areas related to sound symbolism. Our findings also indicate that the material's familiarity might facilitate the development of multisensory processing during the first year of life.
人类的感知系统使我们能够从听觉信息中提取物体材料的视觉属性。在猴子中,这种多感觉关联的神经基础是通过接触某种材料的经验发展起来的;材料信息可以在前颞下皮质中进行处理,从高级视觉区域逐渐进行。然而,在人类中,这种神经表现的发展仍然知之甚少。在这里,我们首次使用近红外光谱 (NIRS) 证明了在 4 至 8 个月大的婴儿的右颞区存在与视觉材料(“金属”和“木材”)的听觉材料属性的映射。此外,我们发现婴儿获得了“金属”材料的音频-视觉映射比“木材”材料的晚,因为婴儿在大约 6 个月大后才形成“金属”材料的视觉属性。这些发现表明,材料信息的多感觉处理会引起与声音象征相关的大脑区域的激活。我们的发现还表明,材料的熟悉度可能会促进生命第一年多感觉处理的发展。