University of California, 900 University Avenue, Riverside, CA 92521, USA.
J Speech Lang Hear Res. 2010 Apr;53(2):262-72. doi: 10.1044/1092-4388(2009/08-0247). Epub 2010 Mar 10.
Speech shadowing experiments were conducted to test whether alignment (inadvertent imitation) to voice onset time (VOT) can be influenced by visual speech information.
Experiment 1 examined whether alignment would occur to auditory /pa/ syllables manipulated to have 3 different VOTs. Nineteen female participants were asked to listen to 180 syllables over headphones and to say each syllable out loud quickly and clearly. In Experiment 2, visual speech tokens composed of a face articulating /pa/ syllables at 2 different rates were dubbed onto the audio /pa/ syllables of Experiment 1. Sixteen new female participants were asked to listen to and watch (over a video monitor) 180 syllables and to say each syllable out loud quickly and clearly.
Results of Experiment 1 showed that the 3 VOTs of the audio /pa/ stimuli influenced the VOTs of the participants' produced syllables. Results of Experiment 2 revealed that both the visible syllable rate and audio VOT of the audiovisual /pa/ stimuli influenced the VOTs of the participants' produced syllables.
These results show that, like auditory speech, visual speech information can induce speech alignment to a phonetically relevant property of an utterance.
进行语音掩蔽实验,以检验视觉语音信息是否会影响语音起始时间(VOT)的对齐(无意模仿)。
实验 1 检验了对具有 3 种不同 VOT 的听觉 /pa/音节进行调整后,是否会发生对齐。19 名女性参与者被要求通过耳机听 180 个音节,并快速清晰地大声说出每个音节。在实验 2 中,将以 2 种不同速度发音的人脸说出的 /pa/音节的视觉语音标记贴到实验 1 的音频 /pa/音节上。16 名新的女性参与者被要求听并观看(通过视频监视器)180 个音节,并快速清晰地大声说出每个音节。
实验 1 的结果表明,音频 /pa/ 刺激的 3 种 VOT 影响了参与者产生的音节的 VOT。实验 2 的结果表明,视听 /pa/ 刺激的可见音节率和音频 VOT 均影响了参与者产生的音节的 VOT。
这些结果表明,与听觉语音一样,视觉语音信息可以诱导语音对齐到一个与发音相关的话语特征。