• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

对手势的隐蔽注意足以获取信息。

Covert Attention to Gestures Is Sufficient for Information Uptake.

作者信息

Kandana Arachchige Kendra Gimhani, Blekic Wivine, Simoes Loureiro Isabelle, Lefebvre Laurent

机构信息

Department of Cognitive Psychology and Neuropsychology, University of Mons, Mons, Belgium.

出版信息

Front Psychol. 2021 Nov 30;12:776867. doi: 10.3389/fpsyg.2021.776867. eCollection 2021.

DOI:10.3389/fpsyg.2021.776867
PMID:34917002
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC8669744/
Abstract

Numerous studies have explored the benefit of iconic gestures in speech comprehension. However, only few studies have investigated how visual attention was allocated to these gestures in the context of clear versus degraded speech and the way information is extracted for enhancing comprehension. This study aimed to explore the effect of iconic gestures on comprehension and whether fixating the gesture is required for information extraction. Four types of gestures (i.e., semantically and syntactically incongruent iconic gestures, meaningless configurations, and congruent iconic gestures) were presented in a sentence context in three different listening conditions (i.e., clear, partly degraded or fully degraded speech). Using eye tracking technology, participants' gaze was recorded, while they watched video clips after which they were invited to answer simple comprehension questions. Results first showed that different types of gestures differently attract attention and that the more speech was degraded, the less participants would pay attention to gestures. Furthermore, semantically incongruent gestures appeared to particularly impair comprehension although not being fixated while congruent gestures appeared to improve comprehension despite also not being fixated. These results suggest that covert attention is sufficient to convey information that will be processed by the listener.

摘要

众多研究探讨了标志性手势在言语理解中的益处。然而,只有少数研究调查了在清晰语音与 degraded 语音的背景下,视觉注意力是如何分配到这些手势上的,以及信息是如何被提取以增强理解的。本研究旨在探讨标志性手势对理解的影响,以及信息提取是否需要注视手势。在三种不同的听力条件(即清晰、部分 degraded 或完全 degraded 语音)下,在句子语境中呈现了四种类型的手势(即语义和句法不一致的标志性手势、无意义的构型和一致的标志性手势)。使用眼动追踪技术,记录参与者观看视频片段时的注视情况,之后邀请他们回答简单的理解问题。结果首先表明,不同类型的手势吸引注意力的方式不同,语音 degraded 程度越高,参与者对手势的关注就越少。此外,语义不一致的手势似乎特别损害理解,尽管没有被注视,而一致的手势似乎能提高理解,尽管同样也没有被注视。这些结果表明,隐蔽注意力足以传达将被听众处理的信息。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/31655a6887d2/fpsyg-12-776867-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/41886579f89e/fpsyg-12-776867-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/17073b5cb862/fpsyg-12-776867-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/b0636854c955/fpsyg-12-776867-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/31655a6887d2/fpsyg-12-776867-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/41886579f89e/fpsyg-12-776867-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/17073b5cb862/fpsyg-12-776867-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/b0636854c955/fpsyg-12-776867-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/829f/8669744/31655a6887d2/fpsyg-12-776867-g004.jpg

相似文献

1
Covert Attention to Gestures Is Sufficient for Information Uptake.对手势的隐蔽注意足以获取信息。
Front Psychol. 2021 Nov 30;12:776867. doi: 10.3389/fpsyg.2021.776867. eCollection 2021.
2
Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension.语言经验程度调节清晰和退化语音理解过程中对可见言语和形象手势的视觉注意。
Cogn Sci. 2019 Oct;43(10):e12789. doi: 10.1111/cogs.12789.
3
The role of iconic gestures in speech disambiguation: ERP evidence.标志性手势在言语歧义消除中的作用:事件相关电位证据。
J Cogn Neurosci. 2007 Jul;19(7):1175-92. doi: 10.1162/jocn.2007.19.7.1175.
4
Visual Context Enhanced: The Joint Contribution of Iconic Gestures and Visible Speech to Degraded Speech Comprehension.视觉语境增强:标志性手势与可视语音对言语理解能力下降的联合作用
J Speech Lang Hear Res. 2017 Jan 1;60(1):212-222. doi: 10.1044/2016_JSLHR-H-16-0101.
5
Hearing and seeing meaning in noise: Alpha, beta, and gamma oscillations predict gestural enhancement of degraded speech comprehension.在噪声中听出意义:α、β 和 γ 脑电波振荡可预测手势对语音理解能力下降的增强作用。
Hum Brain Mapp. 2018 May;39(5):2075-2087. doi: 10.1002/hbm.23987. Epub 2018 Jan 30.
6
Beat Gestures for Comprehension and Recall: Differential Effects of Language Learners and Native Listeners.用于理解和回忆的节拍手势:语言学习者与母语听众的差异效应
Front Psychol. 2020 Oct 19;11:575929. doi: 10.3389/fpsyg.2020.575929. eCollection 2020.
7
Native language status of the listener modulates the neural integration of speech and iconic gestures in clear and adverse listening conditions.在清晰和不利的听力条件下,听众的母语状态会调节语音和标志性手势的神经整合。
Brain Lang. 2018 Feb-Mar;177-178:7-17. doi: 10.1016/j.bandl.2018.01.003.
8
Native and non-native listeners show similar yet distinct oscillatory dynamics when using gestures to access speech in noise.当使用手势来辅助听噪声中的言语时,本族语者和非本族语者听众都会表现出相似但又不同的振荡动力学。
Neuroimage. 2019 Jul 1;194:55-67. doi: 10.1016/j.neuroimage.2019.03.032. Epub 2019 Mar 21.
9
Gesture and reference to objects in the here-and-now: Listeners' use of gesture cues in quiet and in noise.对此时此地的物体的手势和参照:在安静和嘈杂环境中听众对手势线索的使用。
J Exp Psychol Learn Mem Cogn. 2022 Apr;48(4):583-597. doi: 10.1037/xlm0001035. Epub 2021 Jun 28.
10
Lending a hand to storytelling: Gesture's effects on narrative comprehension moderated by task difficulty and cognitive ability.伸出援手讲故事:手势对叙事理解的影响受任务难度和认知能力的调节。
Q J Exp Psychol (Hove). 2021 Oct;74(10):1791-1805. doi: 10.1177/17470218211024913. Epub 2021 Jun 17.

引用本文的文献

1
Automatic Speech-Gesture Integration in Autistic Children: The Role of Gesture Semantic Activation.自闭症儿童的自动言语-手势整合:手势语义激活的作用。
J Autism Dev Disord. 2025 Jun 4. doi: 10.1007/s10803-025-06878-w.

本文引用的文献

1
The Role of Iconic Gestures in Speech Comprehension: An Overview of Various Methodologies.标志性手势在言语理解中的作用:各种方法概述
Front Psychol. 2021 Apr 29;12:634074. doi: 10.3389/fpsyg.2021.634074. eCollection 2021.
2
Verbal working memory and co-speech gesture processing.言语工作记忆与伴随言语的手势加工。
Brain Cogn. 2020 Dec;146:105640. doi: 10.1016/j.bandc.2020.105640. Epub 2020 Nov 7.
3
Salience determines attentional orienting in visual selection.突显度决定视觉选择中的注意定向。
J Exp Psychol Hum Percept Perform. 2020 Oct;46(10):1051-1057. doi: 10.1037/xhp0000796. Epub 2020 Aug 6.
4
Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension.语言经验程度调节清晰和退化语音理解过程中对可见言语和形象手势的视觉注意。
Cogn Sci. 2019 Oct;43(10):e12789. doi: 10.1111/cogs.12789.
5
Non-native Listeners Benefit Less from Gestures and Visible Speech than Native Listeners During Degraded Speech Comprehension.非母语者在听力理解中受益不如母语者多,无论是手势还是可视语音在语音质量下降时。
Lang Speech. 2020 Jun;63(2):209-220. doi: 10.1177/0023830919831311. Epub 2019 Feb 22.
6
Gesture helps learners learn, but not merely by guiding their visual attention.手势有助于学习者学习,但不仅仅是通过引导他们的视觉注意。
Dev Sci. 2018 Nov;21(6):e12664. doi: 10.1111/desc.12664. Epub 2018 Apr 16.
7
Transcranial Magnetic Stimulation over Left Inferior Frontal and Posterior Temporal Cortex Disrupts Gesture-Speech Integration.经颅磁刺激左额下回和后颞叶皮层会干扰手势-言语整合。
J Neurosci. 2018 Feb 21;38(8):1891-1900. doi: 10.1523/JNEUROSCI.1748-17.2017. Epub 2018 Jan 22.
8
Neural Mechanisms of Selective Visual Attention.选择性视觉注意的神经机制。
Annu Rev Psychol. 2017 Jan 3;68:47-72. doi: 10.1146/annurev-psych-122414-033400.
9
Visual Context Enhanced: The Joint Contribution of Iconic Gestures and Visible Speech to Degraded Speech Comprehension.视觉语境增强:标志性手势与可视语音对言语理解能力下降的联合作用
J Speech Lang Hear Res. 2017 Jan 1;60(1):212-222. doi: 10.1044/2016_JSLHR-H-16-0101.
10
The Development of the Ability to Semantically Integrate Information in Speech and Iconic Gesture in Comprehension.言语和具象手势中语义信息整合能力的发展及其在理解中的作用。
Cogn Sci. 2015 Nov;39(8):1855-80. doi: 10.1111/cogs.12221. Epub 2015 Mar 17.