Scarborough Rebecca, Keating Patricia, Mattys Sven L, Cho Taehong, Alwan Abeer
Linguistics Department, University of Colorado, Boulder, CO 80309, USA.
Lang Speech. 2009;52(Pt 2-3):135-75. doi: 10.1177/0023830909103165.
In a study of optical cues to the visual perception of stress, three American English talkers spoke words that differed in lexical stress and sentences that differed in phrasal stress, while video and movements of the face were recorded. The production of stressed and unstressed syllables from these utterances was analyzed along many measures of facial movement, which were generally larger and faster in the stressed condition. In a visual perception experiment, 16 perceivers identified the location of stress in forced-choice judgments of video clips of these utterances (without audio). Phrasal stress was better perceived than lexical stress. The relation of the visual intelligibility of the prosody of these utterances to the optical characteristics of their production was analyzed to determine which cues are associated with successful visual perception. While most optical measures were correlated with perception performance, chin measures, especially Chin Opening Displacement, contributed the most to correct perception independently of the other measures. Thus, our results indicate that the information for visual stress perception is mainly associated with mouth opening movements.
在一项关于压力视觉感知的视觉线索研究中,三名美式英语说话者说出了词汇重音不同的单词和短语重音不同的句子,同时记录了面部的视频和动作。从这些话语中产生的重读音节和非重读音节沿着许多面部运动指标进行了分析,在重音条件下,这些指标通常更大、更快。在一项视觉感知实验中,16名感知者在对这些话语的视频片段(无音频)进行强制选择判断时,确定了重音的位置。短语重音比词汇重音更容易被感知。分析了这些话语韵律的视觉可懂度与其产生的光学特征之间的关系,以确定哪些线索与成功的视觉感知相关。虽然大多数光学指标与感知表现相关,但下巴指标,尤其是下巴开口位移,独立于其他指标,对正确感知的贡献最大。因此,我们的结果表明,视觉压力感知的信息主要与嘴巴张开动作有关。