Suppr超能文献

使用视频和点光显示中的语音和非语音面部手势进行视觉语音处理。

Visual phonetic processing localized using speech and nonspeech face gestures in video and point-light displays.

机构信息

Division of Communication and Auditory Neuroscience, House Ear Institute, Los Angeles, California, USA.

出版信息

Hum Brain Mapp. 2011 Oct;32(10):1660-76. doi: 10.1002/hbm.21139. Epub 2010 Sep 17.

Abstract

The talking face affords multiple types of information. To isolate cortical sites with responsibility for integrating linguistically relevant visual speech cues, speech and nonspeech face gestures were presented in natural video and point-light displays during fMRI scanning at 3.0T. Participants with normal hearing viewed the stimuli and also viewed localizers for the fusiform face area (FFA), the lateral occipital complex (LOC), and the visual motion (V5/MT) regions of interest (ROIs). The FFA, the LOC, and V5/MT were significantly less activated for speech relative to nonspeech and control stimuli. Distinct activation of the posterior superior temporal sulcus and the adjacent middle temporal gyrus to speech, independent of media, was obtained in group analyses. Individual analyses showed that speech and nonspeech stimuli were associated with adjacent but different activations, with the speech activations more anterior. We suggest that the speech activation area is the temporal visual speech area (TVSA), and that it can be localized with the combination of stimuli used in this study.

摘要

说话人脸提供多种类型的信息。为了分离负责整合与语言相关的视觉语音线索的皮质部位,在 3.0T 的 fMRI 扫描中,以自然视频和点光显示呈现语音和非语音面部手势。正常听力的参与者观看了刺激物,还观看了梭状回面孔区(FFA)、外侧枕叶复合体(LOC)和视觉运动(V5/MT)感兴趣区(ROI)的定位器。FFA、LOC 和 V5/MT 对语音的激活程度明显低于非语音和对照刺激。在组分析中获得了后颞上沟和相邻颞中回对语音的独立激活,而与媒体无关。个体分析表明,语音和非语音刺激与相邻但不同的激活有关,语音激活更靠前。我们认为,语音激活区是颞视觉语音区(TVSA),并且可以使用本研究中使用的组合刺激来定位。

相似文献

6
Social cues, mentalizing and the neural processing of speech accompanied by gestures.社会线索、心理化与言语伴随手势的神经加工。
Neuropsychologia. 2010 Jan;48(2):382-93. doi: 10.1016/j.neuropsychologia.2009.09.025. Epub 2009 Sep 25.

引用本文的文献

4
Inhibitory TMS over Visual Area V5/MT Disrupts Visual Speech Recognition.视觉区 V5/MT 的抑制性 TMS 会干扰视觉言语识别。
J Neurosci. 2023 Nov 8;43(45):7690-7699. doi: 10.1523/JNEUROSCI.0975-23.2023. Epub 2023 Oct 17.

本文引用的文献

3
Speech Perception as a Multimodal Phenomenon.作为一种多模态现象的言语感知
Curr Dir Psychol Sci. 2008 Dec;17(6):405-409. doi: 10.1111/j.1467-8721.2008.00615.x.
5
Multisensory anatomical pathways.多感觉解剖通路。
Hear Res. 2009 Dec;258(1-2):28-36. doi: 10.1016/j.heares.2009.04.017. Epub 2009 May 4.
6
Mismatch negativity with visual-only and audiovisual speech.仅视觉和视听言语的失配负波。
Brain Topogr. 2009 May;21(3-4):207-15. doi: 10.1007/s10548-009-0094-5. Epub 2009 Apr 30.
9
Motor speech perception modulates the cortical language areas.运动性言语感知调节皮层语言区域。
Neuroimage. 2008 Jun;41(2):605-13. doi: 10.1016/j.neuroimage.2008.02.046. Epub 2008 Mar 6.
10
Cortical circuits for silent speechreading in deaf and hearing people.聋人和听力正常者默读唇语的皮质回路。
Neuropsychologia. 2008 Apr;46(5):1233-41. doi: 10.1016/j.neuropsychologia.2007.11.026. Epub 2007 Dec 5.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验