Benoît C, Mohamadi T, Kandel S
Institut de la Communication Parlée, URA CNRS no. 368, INPG-ENSERG/Université Stendhal, Grenoble, France.
J Speech Hear Res. 1994 Oct;37(5):1195-203. doi: 10.1044/jshr.3705.1195.
Bimodal perception leads to better speech understanding than auditory perception alone. We evaluated the overall benefit of lip-reading on natural utterances of French produced by a single speaker. Eighteen French subjects with good audition and vision were administered a closed set identification test of VCVCV nonsense words consisting of three vowels [i, a, y] and six consonants [b, v, z, 3, R, l]. Stimuli were presented under both auditory and audio-visual conditions with white noise added at various signal-to-noise ratios. Identification scores were higher in the bimodal condition than in the auditory-alone condition, especially in situations where acoustic information was reduced. The auditory and audio-visual intelligibility of the three vowels [i, a, y] averaged over the six consonantal contexts was evaluated as well. Two different hierarchies of intelligibility were found. Auditorily, [a] was most intelligible, followed by [i] and then by [y]; whereas visually [y] was most intelligible, followed by [a] and [i]. We also quantified the contextual effects of the three vowels on the auditory and audio-visual intelligibility of the consonants. Both the auditory and the audio-visual intelligibility of surrounding consonants was highest in the [a] context, followed by the [i] context and lastly the [y] context.
双峰感知比单纯的听觉感知能带来更好的言语理解。我们评估了唇读对单一声源发出的法语自然话语的总体益处。对18名听力和视力良好的法国受试者进行了一项封闭集识别测试，测试内容为包含三个元音[i, a, y]和六个辅音[b, v, z, 3, R, l]的VCVCV无意义单词。在添加了不同信噪比白噪声的听觉和视听条件下呈现刺激。双峰条件下的识别分数高于仅听觉条件下的分数，尤其是在声学信息减少的情况下。还评估了在六个辅音语境中平均的三个元音[i, a, y]的听觉和视听可懂度。发现了两种不同的可懂度层级。在听觉上，[a]最易听懂，其次是[i]，然后是[y]；而在视觉上，[y]最易听懂，其次是[a]和[i]。我们还量化了这三个元音对辅音听觉和视听可懂度的语境效应。周围辅音的听觉和视听可懂度在[a]语境中最高，其次是[i]语境，最后是[y]语境。
