Eindhoven University of Technology, IPO 1.25, P.O. Box 513, 5600 MB Eindhoven, The Netherlands.
Exp Brain Res. 2012 Sep;221(4):403-12. doi: 10.1007/s00221-012-3182-9. Epub 2012 Jul 22.
The integration of visual and auditory inputs in the human brain occurs only if the components are perceived in temporal proximity, that is, when the intermodal time difference falls within the so-called subjective synchrony range. We used the midpoint of this range to estimate the point of subjective simultaneity (PSS). We measured the PSS for audio-visual (AV) stimuli in a synchrony judgment task, in which subjects had to judge a given AV stimulus using three response categories (audio first, synchronous, video first). The relevant stimulus manipulation was the duration of the auditory and visual components. Results for unimodal auditory and visual stimuli have shown that the perceived onset shifts to relatively later positions with increasing stimulus duration. These unimodal shifts should be reflected in changing PSS values, when AV stimuli with different durations of the auditory and visual components are used. The results for 17 subjects showed indeed a significant shift of the PSS for different duration combinations of the stimulus components. Because the shifts were approximately equal for duration changes in either of the components, no net shift of the PSS was observed as long as the durations of the two components were equal. This result indicates the need to appropriately account for unimodal timing effects when quantifying intermodal synchrony perception.
人类大脑中视觉和听觉输入的整合只有在组件被感知到时间接近的情况下才会发生,也就是说,当模态间时间差落在所谓的主观同步范围内时。我们使用这个范围的中点来估计主观同时性的点(PSS)。我们在同步判断任务中测量了视听(AV)刺激的 PSS,在这个任务中,被试必须使用三个反应类别(音频先、同步、视频先)来判断给定的 AV 刺激。相关的刺激操作是听觉和视觉成分的持续时间。对于单模态听觉和视觉刺激的结果表明,随着刺激持续时间的增加,感知的起始位置会相对向后移动。当使用具有不同听觉和视觉成分持续时间的视听刺激时,这些单模态的变化应该反映在不断变化的 PSS 值中。对于 17 名被试的结果确实显示了 PSS 在刺激成分的不同持续时间组合下的显著变化。由于在任何一个成分的持续时间变化中,变化的幅度大致相等,只要两个成分的持续时间相等,就不会观察到 PSS 的净变化。这一结果表明,在量化跨模态同步感知时,需要适当考虑单模态时间效应。