Department of Psychological and Brain Sciences, Indiana University, United States.
Neuropsychologia. 2011 Jan;49(1):108-14. doi: 10.1016/j.neuropsychologia.2010.10.030. Epub 2010 Oct 29.
Environmental events produce many sensory cues for identifying the action that evoked the event, the agent that performed the action, and the object targeted by the action. The cues for identifying environmental events are usually distributed across multiple sensory systems. Thus, to understand how environmental events are recognized requires an understanding of the fundamental cognitive and neural processes involved in multisensory object and action recognition. Here, we investigated the neural substrates involved in auditory and visual recognition of object-directed actions. Consistent with previous work on visual recognition of isolated objects, visual recognition of actions, and recognition of environmental sounds, we found evidence for multisensory audiovisual event-selective activation bilaterally at the junction of the posterior middle temporal gyrus and the lateral occipital cortex, the left superior temporal sulcus, and bilaterally in the intraparietal sulcus. The results suggest that recognition of events through convergence of visual and auditory cues is accomplished through a network of brain regions that was previously implicated only in visual recognition of action.
环境事件产生许多感觉提示，用于识别引发事件的动作、执行动作的主体以及动作的目标对象。用于识别环境事件的提示通常分布在多个感觉系统中。因此，要理解环境事件是如何被识别的，就需要了解多感觉物体和动作识别所涉及的基本认知和神经过程。在这里，我们研究了听觉和视觉识别物体指向动作所涉及的神经基质。与之前关于孤立物体的视觉识别、动作的视觉识别以及环境声音的识别的工作一致，我们发现了证据表明，在颞中后回和外侧枕叶皮层交界处、左侧颞上沟以及顶内沟双侧存在多感觉视听事件选择性激活。结果表明，通过视觉和听觉线索的融合来识别事件是通过一个先前仅涉及动作视觉识别的脑区网络来完成的。
