Schneider Till R, Engel Andreas K, Debener Stefan
Department of Neurophysiology and Pathophysiology, Center of Experimental Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Exp Psychol. 2008;55(2):121-32. doi: 10.1027/1618-3169.55.2.121.
The question of how vision and audition interact in natural object identification is currently a matter of debate. We developed a large set of auditory and visual stimuli representing natural objects in order to facilitate research in the field of multisensory processing. Normative data was obtained for 270 brief environmental sounds and 320 visual object stimuli. Each stimulus was named, categorized, and rated with regard to familiarity and emotional valence by N=56 participants (Study 1). This multimodal stimulus set was employed in two subsequent crossmodal priming experiments that used semantically congruent and incongruent stimulus pairs in a S1-S2 paradigm. Task-relevant targets were either auditory (Study 2) or visual stimuli (Study 3). The behavioral data of both experiments expressed a crossmodal priming effect with shorter reaction times for congruent as compared to incongruent stimulus pairs. The observed facilitation effect suggests that object identification in one modality is influenced by input from another modality. This result implicates that congruent visual and auditory stimulus pairs were perceived as the same object and demonstrates a first validation of the multimodal stimulus set.
视觉和听觉在自然物体识别中如何相互作用的问题目前仍存在争议。我们开发了大量代表自然物体的听觉和视觉刺激，以促进多感官处理领域的研究。获取了270种简短环境声音和320种视觉物体刺激的规范数据。N = 56名参与者对每个刺激进行了命名、分类，并就熟悉度和情感效价进行了评分（研究1）。这个多模态刺激集被用于随后的两个跨模态启动实验中，这两个实验在S1 - S2范式中使用了语义一致和不一致的刺激对。与任务相关的目标要么是听觉刺激（研究2），要么是视觉刺激（研究3）。两个实验的行为数据都表现出跨模态启动效应，与不一致的刺激对相比，一致的刺激对反应时间更短。观察到的促进效应表明，一种模态中的物体识别受到另一种模态输入的影响。这一结果意味着一致的视觉和听觉刺激对被视为同一物体，并证明了多模态刺激集的首次验证。
