Scheef Lukas, Boecker Henning, Daamen Marcel, Fehse Ursula, Landsberg Martin W, Granath Dirk-Oliver, Mechling Heinz, Effenberg Alfred O
Department of Radiology, University of Bonn, Germany.
Brain Res. 2009 Feb 3;1252:94-104. doi: 10.1016/j.brainres.2008.10.067. Epub 2008 Nov 11.
Audio-visual integration in the human brain influences perception and precision of motor tasks. We tested audio-visual integration during height estimation when presenting video clips of counter movement jumps (CMJ), using sparse sampling fMRI at 3T. Employing the technique of "sonification", we created artificial auditory-visual motion events by transforming the ground reaction force of the CMJs into the auditory domain, modulating frequency and amplitude of the standard pitch "A" (440 Hz). We combined these "sonificated" movements with either concordant or discordant visual movement displays. We hypothesized that processing of concordant audio-visual stimuli would enhance neural activity in audio-visual integration areas. Therefore, four conditions were compared: 1. unimodal visual, 2. unimodal auditory, 3. auditory+visual concordant, and 4. auditory+visual discordant. The unimodal conditions, when compared against each other, resulted in expected activation maxima in primary visual and auditory cortex, respectively. Enhanced activation was found in area V5/MT bilaterally for the concordant multimodal, as compared to both unimodal, conditions. This effect was specific for the concordant bimodal condition, as evidenced by a direct comparison between concordant and discordant bimodal conditions. Using "sonification", we provide evidence that area V5/MT is modulated by concordant auditory input, albeit the artificial nature of the stimuli, which argues for a role of this region in multimodal motion integration, beyond the pure visual domain. This may explain previous behavioral evidence of facilitatory effects exerted by auditory motion stimuli on the perception of visual motion, and may provide the basis for future applications in motor learning and rehabilitation.
人类大脑中的视听整合会影响运动任务的感知和精度。我们在3T场强下使用稀疏采样功能磁共振成像（fMRI），在呈现反向纵跳（CMJ）视频片段时测试了高度估计过程中的视听整合。采用“声波化”技术，我们通过将CMJ的地面反作用力转换到听觉领域，调制标准音高“A”（440赫兹）的频率和振幅，创建了人工视听运动事件。我们将这些“声波化”运动与一致或不一致的视觉运动显示相结合。我们假设，处理一致的视听刺激会增强视听整合区域的神经活动。因此，我们比较了四种情况：1. 单峰视觉，2. 单峰听觉，3. 听觉+视觉一致，4. 听觉+视觉不一致。相互比较时，单峰情况分别在初级视觉和听觉皮层产生了预期的激活最大值。与两种单峰情况相比，双侧V5/MT区域在一致的多峰情况下有增强的激活。通过一致和不一致的双峰情况之间的直接比较证明，这种效应是一致的双峰情况所特有的。通过“声波化”，我们提供了证据表明V5/MT区域受到一致听觉输入的调制，尽管刺激具有人工性质，这表明该区域在多峰运动整合中发挥作用，超出了单纯的视觉领域。这可能解释了先前关于听觉运动刺激对视觉运动感知产生促进作用的行为证据，并可能为未来在运动学习和康复中的应用提供基础。
