Department of Psychology, University of New Brunswick, Saint John, NB, Canada.
Department of Psychological & Brain Sciences, Washington University in St. Louis, Saint Louis, MO, USA.
Atten Percept Psychophys. 2022 Aug;84(6):1809-1819. doi: 10.3758/s13414-022-02517-z. Epub 2022 May 24.
Many natural events generate both visual and auditory signals, and humans are remarkably adept at integrating information from those sources. However, individuals appear to differ markedly in their ability or propensity to combine what they hear with what they see. Individual differences in audiovisual integration have been established using a range of materials, including speech stimuli (seeing and hearing a talker) and simpler audiovisual stimuli (seeing flashes of light combined with tones). Although there are multiple tasks in the literature that are referred to as "measures of audiovisual integration," the tasks themselves differ widely with respect to both the type of stimuli used (speech versus non-speech) and the nature of the tasks themselves (e.g., some tasks use conflicting auditory and visual stimuli whereas others use congruent stimuli). It is not clear whether these varied tasks are actually measuring the same underlying construct: audiovisual integration. This study tested the relationships among four commonly-used measures of audiovisual integration, two of which use speech stimuli (susceptibility to the McGurk effect and a measure of audiovisual benefit), and two of which use non-speech stimuli (the sound-induced flash illusion and audiovisual integration capacity). We replicated previous work showing large individual differences in each measure but found no significant correlations among any of the measures. These results suggest that tasks that are commonly referred to as measures of audiovisual integration may be tapping into different parts of the same process or different constructs entirely.
许多自然事件会同时产生视觉和听觉信号，而人类在整合来自这些来源的信息方面非常出色。然而，个体在将听到的内容与看到的内容结合起来的能力或倾向方面似乎存在显著差异。个体在视听整合方面的差异已经通过一系列材料得到了证实，包括语音刺激（看到和听到说话者）和更简单的视听刺激（看到闪光与听到声音的组合）。尽管文献中有多种被称为“视听整合测量”的任务，但这些任务本身在使用的刺激类型（语音与非语音）和任务本身的性质（例如，一些任务使用冲突的听觉和视觉刺激，而另一些任务则使用一致的刺激）方面存在很大差异。目前尚不清楚这些不同的任务是否实际上都在测量相同的潜在结构：视听整合。本研究测试了四种常用的视听整合测量方法之间的关系，其中两种使用语音刺激（麦格克效应的敏感性和视听增益的测量），另外两种使用非语音刺激（声音诱导的闪光错觉和视听整合能力）。我们复制了之前的工作，表明每种测量方法都存在很大的个体差异，但在任何测量方法之间都没有发现显著的相关性。这些结果表明，通常被称为视听整合测量的任务可能涉及到同一过程的不同部分，或者完全涉及不同的结构。
