Kuling Irene A, Kohlrausch Armin, Juola James F
Human-Technology Interaction Group, School of Innovation Sciences, Eindhoven University of Technology, IPO 1.25, P.O. Box 513, 5600 MB, Eindhoven, The Netherlands.
Atten Percept Psychophys. 2013 Oct;75(7):1583-99. doi: 10.3758/s13414-013-0511-4.
The integration of visual and auditory inputs in the human brain works properly only if the components are perceived in close temporal proximity. In the present study, we quantified cross-modal interactions in the human brain for audiovisual stimuli with temporal asynchronies, using a paradigm from rhythm perception. In this method, participants had to align the temporal position of a target in a rhythmic sequence of four markers. In the first experiment, target and markers consisted of a visual flash or an auditory noise burst, and all four combinations of target and marker modalities were tested. In the same-modality conditions, no temporal biases and a high precision of the adjusted temporal position of the target were observed. In the different-modality conditions, we found a systematic temporal bias of 25-30 ms. In the second part of the first and in a second experiment, we tested conditions in which audiovisual markers with different stimulus onset asynchronies (SOAs) between the two components and a visual target were used to quantify temporal ventriloquism. The adjusted target positions varied by up to about 50 ms and depended in a systematic way on the SOA and its proximity to the point of subjective synchrony. These data allowed testing different quantitative models. The most satisfying model, based on work by Maij, Brenner, and Smeets (Journal of Neurophysiology 102, 490-495, 2009), linked temporal ventriloquism and the percept of synchrony and was capable of adequately describing the results from the present study, as well as those of some earlier experiments.
只有当视觉和听觉输入的各个组成部分在时间上被感知为接近时，它们在人脑中的整合才能正常工作。在本研究中，我们使用节奏感知范式，对具有时间异步性的视听刺激在人脑中的跨模态交互进行了量化。在这种方法中，参与者必须在四个标记的有节奏序列中对齐目标的时间位置。在第一个实验中，目标和标记由视觉闪光或听觉噪声爆发组成，并测试了目标和标记模态的所有四种组合。在同模态条件下，未观察到时间偏差，且目标调整后的时间位置具有高精度。在不同模态条件下，我们发现了25 - 30毫秒的系统性时间偏差。在第一个实验的第二部分以及第二个实验中，我们测试了使用两个组成部分之间具有不同刺激起始异步性（SOA）的视听标记和一个视觉目标来量化时间视错觉的条件。调整后的目标位置变化高达约50毫秒，并以系统的方式取决于SOA及其与主观同步点的接近程度。这些数据允许测试不同的定量模型。基于迈伊、布伦纳和斯米茨（《神经生理学杂志》102卷，490 - 495页，2009年）的研究成果，最令人满意的模型将时间视错觉与同步感知联系起来，并且能够充分描述本研究以及一些早期实验的结果。
