Talsma Durk, Doty Tracy J, Woldorff Marty G
Center for Cognitive Neuroscience, Duke University, Durham, NC, USA.
Cereb Cortex. 2007 Mar;17(3):679-90. doi: 10.1093/cercor/bhk016. Epub 2006 May 17.
Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and (A + V) responses and were studied while attention was directed to one or both modalities or directed elsewhere. Results show that multisensory integration effects depend on the multisensory objects being fully attended--that is, when both the visual and auditory senses were attended. In this condition, a superadditive audiovisual integration effect was observed on the P50 component. When unattended, this effect was reversed; the P50 components of multisensory ERPs were smaller than the unisensory sum. Additionally, we found an enhanced late frontal negativity when subjects attended the visual component of a multisensory object. This effect, bearing a strong resemblance to the auditory processing negativity, appeared to reflect late attention-related processing that had spread to encompass the auditory component of the multisensory object. In conclusion, our results shed new light on how the brain processes multisensory auditory and visual information, including how attention modulates multisensory integration processes.
采用视听流联合设计和快速序列视觉呈现范式，研究了多感官整合与注意力之间的相互作用。将视听对象（AV）之后的事件相关电位（ERP）与听觉对象（A）和视觉对象（V）之后的ERP之和进行比较。整合过程表示为这些AV与（A + V）反应之间的差异，并在注意力指向一种或两种模态或指向其他地方时进行研究。结果表明，多感官整合效应取决于多感官对象是否被充分关注——也就是说，当视觉和听觉都被关注时。在这种情况下，在P50成分上观察到超相加性视听整合效应。当未被关注时，这种效应会逆转；多感官ERP的P50成分小于单感官之和。此外，我们发现当受试者关注多感官对象的视觉成分时，晚期额叶负波增强。这种效应与听觉加工负波非常相似，似乎反映了晚期注意力相关加工已经扩展到包括多感官对象的听觉成分。总之，我们的结果为大脑如何处理多感官听觉和视觉信息，包括注意力如何调节多感官整合过程，提供了新的线索。
