Brungart Douglas S, Kordik Alexander J, Simpson Brian D
Air Force Research Laboratory, Wright-Patterson Air Force Base, Ohio 45433-7901, USA.
Hum Factors. 2005 Fall;47(3):562-73. doi: 10.1518/001872005774860023.
Although audiovisual (AV) cues are known to improve speech intelligibility in difficult listening environments, little is known about their role in divided attention tasks that require listeners to monitor multiple talkers at the same time. In this experiment, a call-sign-based multitalker listening test was used to evaluate performance in two-talker AV configurations that combined zero, one, or two channels of visual information (neither, one, or both talkers visible) with zero, one, or two channels of audio information (no audio, both talkers played from the same loudspeaker, and both talkers played through different, spatially separated loudspeakers). The results were analyzed to determine the relative performance levels that would occur with each AV configuration with target information that was equally likely to originate from either of the two talkers in the stimulus. The results indicate that spatial separation of the audio signals has the greatest impact on performance in multichannel AV speech displays and that caution should be used when presenting a visual representation of only a single talker unless that talker is known to be the highest priority talker in the combined AV stimulus. Potential applications of this research include the design of improved audiovisual speech displays for multichannel communications systems.
虽然已知视听（AV）线索能在困难的聆听环境中提高言语可懂度，但对于它们在要求听众同时监测多个讲话者的注意力分散任务中的作用却知之甚少。在本实验中，一项基于呼号的多讲话者聆听测试被用于评估双讲话者AV配置中的表现，该配置将零、一或两个视觉信息通道（两个讲话者都不可见、仅一个讲话者可见、两个讲话者都可见）与零、一或两个音频信息通道（无音频、两个讲话者通过同一个扬声器播放、两个讲话者通过不同的、空间上分离的扬声器播放）进行组合。对结果进行分析，以确定在每种AV配置下，目标信息等可能源自刺激中的两个讲话者之一时的相对表现水平。结果表明，音频信号的空间分离对多通道AV言语显示中的表现影响最大，并且在仅呈现单个讲话者的视觉表示时应谨慎，除非已知该讲话者是组合AV刺激中优先级最高的讲话者。本研究的潜在应用包括为多通道通信系统设计改进的视听言语显示。
