Department of Audiology, Speech-Language Pathology & Deaf Studies, Towson University, MD, USA.
Int J Lang Commun Disord. 2011 Sep-Oct;46(5):535-49. doi: 10.1111/j.1460-6984.2011.00005.x. Epub 2011 Mar 7.
There is a large body of research demonstrating the impact of visual information on speaker intelligibility in both normal and disordered speaker populations. However, there is minimal information on which specific visual features listeners find salient during conversational discourse.
To investigate listeners' eye-gaze behaviour during face-to-face conversation with normal, laryngeal and proficient alaryngeal speakers.
METHODS & PROCEDURES: Sixty participants individually participated in a 10-min conversation with one of four speakers (typical laryngeal, tracheoesophageal, oesophageal, electrolaryngeal; 15 participants randomly assigned to one mode of speech). All speakers were > 85% intelligible and were judged to be 'proficient' by two certified speech-language pathologists. Participants were fitted with a head-mounted eye-gaze tracking device (Mobile Eye, ASL) that calculated the region of interest and mean duration of eye-gaze. Self-reported gaze behaviour was also obtained following the conversation using a 10 cm visual analogue scale.
OUTCOMES & RESULTS: While listening, participants viewed the lower facial region of the oesophageal speaker more than the normal or tracheoesophageal speaker. Results of non-hierarchical cluster analyses showed that while listening, the pattern of eye-gaze was predominantly directed at the lower face of the oesophageal and electrolaryngeal speaker and more evenly dispersed among the background, lower face, and eyes of the normal and tracheoesophageal speakers. Finally, results show a low correlation between self-reported eye-gaze behaviour and objective regions of interest data.
CONCLUSIONS & IMPLICATIONS: Overall, results suggest similar eye-gaze behaviour when healthy controls converse with normal and tracheoesophageal speakers and that participants had significantly different eye-gaze patterns when conversing with an oesophageal speaker. Results are discussed in terms of existing eye-gaze data and its potential implications on auditory-visual speech perception.
大量研究表明，视觉信息对正常和言语障碍者的言语可懂度都有影响。然而，关于听众在会话中发现哪些特定视觉特征突出的信息却很少。
调查正常、喉和熟练人工喉使用者在面对面交谈中听众的眼动行为。
60 名参与者分别与四位说话者（典型的喉、气管食管、食管、电子喉；15 名参与者随机分配到一种说话方式）进行了 10 分钟的对话。所有说话者的言语清晰度>85%，并由两名经过认证的言语语言病理学家判断为“熟练”。参与者佩戴了一个头戴式眼动跟踪装置（Mobile Eye，ASL），该装置计算了兴趣区域和平均眼动时间。在对话结束后，还使用 10 厘米的视觉模拟量表获得了自我报告的注视行为。
在倾听时，参与者比正常或气管食管说话者更多地注视食管说话者的下脸部区域。非层次聚类分析的结果表明，在倾听时，眼动模式主要集中在食管和电子喉说话者的下脸部，而在正常和气管食管说话者中，眼动则更均匀地分散在背景、下脸部和眼睛之间。最后，结果表明自我报告的眼动行为与客观的兴趣区域数据之间相关性较低。
总体而言，结果表明健康对照者与正常和气管食管说话者交谈时具有相似的眼动行为，而与食管说话者交谈时，参与者的眼动模式有显著差异。结果从现有的眼动数据及其对听觉-视觉言语感知的潜在影响进行了讨论。
