Why We Should Study Multimodal Language.
作者信息
Perniss Pamela
机构信息
School of Humanities, University of Brighton, Brighton, United Kingdom.
出版信息
Front Psychol. 2018 Jun 28;9:1109. doi: 10.3389/fpsyg.2018.01109. eCollection 2018.
Abstract
摘要
相似文献
1
Why We Should Study Multimodal Language.我们为何要研究多模态语言。
Front Psychol. 2018 Jun 28;9:1109. doi: 10.3389/fpsyg.2018.01109. eCollection 2018.
2
Neural systems supporting linguistic structure, linguistic experience, and symbolic communication in sign language and gesture.支持手语和手势中语言结构、语言经验及符号交流的神经系统。
Proc Natl Acad Sci U S A. 2015 Sep 15;112(37):11684-9. doi: 10.1073/pnas.1510527112. Epub 2015 Aug 17.
3
A multimodal parallel architecture: A cognitive framework for multimodal interactions.一种多模态并行架构：多模态交互的认知框架。
Cognition. 2016 Jan;146:304-23. doi: 10.1016/j.cognition.2015.10.007. Epub 2015 Nov 9.
4
A Kinect-Based Sign Language Hand Gesture Recognition System for Hearing- and Speech-Impaired: A Pilot Study of Pakistani Sign Language.一种基于Kinect的听力和言语障碍者手语手势识别系统：巴基斯坦手语的初步研究
Assist Technol. 2015 Spring;27(1):34-43. doi: 10.1080/10400435.2014.952845.
5
A Component-Based Vocabulary-Extensible Sign Language Gesture Recognition Framework.一种基于组件的词汇可扩展手语手势识别框架。
Sensors (Basel). 2016 Apr 19;16(4):556. doi: 10.3390/s16040556.
6
What the hands can tell us about language emergence.手能告诉我们关于语言起源的哪些信息。
Psychon Bull Rev. 2017 Feb;24(1):213-218. doi: 10.3758/s13423-016-1074-x.
7
Contributions of Sign Language Research to Gesture Understanding: What can Multimodal Computational Systems Learn from Sign Language Research.手语研究对手势理解的贡献：多模态计算系统能从手语研究中学到什么。
Int J Semant Comput. 2008;2(1):5-9. doi: 10.1142/S1793351X08000324.
8
What sign language creation teaches us about language.手语的创造如何启示我们认识语言
Wiley Interdiscip Rev Cogn Sci. 2013 Mar;4(2):201-211. doi: 10.1002/wcs.1212. Epub 2012 Dec 20.
9
From gesture to sign language: conventionalization of classifier constructions by adult hearing learners of British Sign Language.从手势到手语：英国手语成年听力学习者对手势结构的规约化
Top Cogn Sci. 2015 Jan;7(1):61-80. doi: 10.1111/tops.12118. Epub 2014 Oct 20.
10
Visible cohesion: a comparison of reference tracking in sign, speech, and co-speech gesture.可见衔接：手语、言语和伴随言语手势中参照追踪的比较
Top Cogn Sci. 2015 Jan;7(1):36-60. doi: 10.1111/tops.12122. Epub 2014 Dec 4.
引用本文的文献
1
Flexible use of multimodal communicative strategies in adult chimpanzees.成年黑猩猩对多模态交际策略的灵活运用。
Sci Rep. 2025 Sep 9;15(1):32384. doi: 10.1038/s41598-025-14835-x.
2
Gesture links language and cognition for spoken and signed languages.手势将口语和手语的语言与认知联系起来。
Nat Rev Psychol. 2023 Jul;2(7):407-420. doi: 10.1038/s44159-023-00186-9. Epub 2023 May 25.
3
Tactile Cues and Object Use in Multimodal Communicative Behaviors: Parent-Infant Interactions From 9 to 12 months of Age.多模态交流行为中的触觉线索与物体使用：9至12个月大的亲子互动
Infancy. 2025 Jul-Aug;30(4):e70038. doi: 10.1111/infa.70038.
4
Multimodal Skills, but Not Motor Skills, Predict Narrative and Expressive Pragmatic Skills in Children With Typical Development and Neurodevelopmental Disorders.多模态技能而非运动技能可预测发育正常儿童和神经发育障碍儿童的叙事和表达性语用技能。
Child Dev. 2025 Sep-Oct;96(5):1807-1824. doi: 10.1111/cdev.70015. Epub 2025 Jul 16.
5
Relationship Between Gestures and Vocabulary in 14-Month-Old Swedish-Learning Children.14个月大学习瑞典语的儿童手势与词汇之间的关系
Scand J Psychol. 2025 Apr;66(2):219-230. doi: 10.1111/sjop.13077. Epub 2024 Oct 23.
6
Gestures, Objects, and Spaces: Exploring Teachers' Multimodal Communication in Nursery Schools.手势、物品与空间：探索幼儿园教师的多模态交流
Eur J Psychol. 2024 May 29;20(2):129-142. doi: 10.5964/ejop.12291. eCollection 2024 May.
7
Semantic and syntactic processing of emojis in sentential intermediate positions.句子中间位置表情符号的语义和句法处理。
Cogn Neurodyn. 2024 Aug;18(4):1743-1752. doi: 10.1007/s11571-023-10037-1. Epub 2023 Dec 13.
8
Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues.词汇重音的视听感知：节拍手势与发音线索
Lang Speech. 2025 Mar;68(1):181-203. doi: 10.1177/00238309241258162. Epub 2024 Jun 14.
9
Infant-directed communication: Examining the many dimensions of everyday caregiver-infant interactions.婴儿导向式沟通：审视日常照护者与婴儿互动的多个维度。
Dev Sci. 2024 Sep;27(5):e13515. doi: 10.1111/desc.13515. Epub 2024 Apr 15.
10
Conversational facial signals combine into compositional meanings that change the interpretation of speaker intentions.对话式面部信号组合成具有构成意义的内容，这些意义会改变对说话者意图的解读。
Sci Rep. 2024 Jan 27;14(1):2286. doi: 10.1038/s41598-024-52589-0.
本文引用的文献
1
Gesture or sign? A categorization problem.手势还是符号？一个分类问题。
Behav Brain Sci. 2017 Jan;40:e66. doi: 10.1017/S0140525X15003015.
2
Perceived Conventionality in Co-speech Gestures Involves the Fronto-Temporal Language Network.共同言语手势中的感知常规性涉及额颞叶语言网络。
Front Hum Neurosci. 2017 Nov 30;11:573. doi: 10.3389/fnhum.2017.00573. eCollection 2017.
3
Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study.自发产生的表征性伴随言语手势的多模态整合：一项功能磁共振成像研究。
Lang Cogn Neurosci. 2017;32(2):158-174. doi: 10.1080/23273798.2016.1245426. Epub 2016 Oct 28.
4
The combined use of virtual reality and EEG to study language processing in naturalistic environments.虚拟现实和脑电图结合使用来研究自然环境中的语言处理。
Behav Res Methods. 2018 Apr;50(2):862-869. doi: 10.3758/s13428-017-0911-9.
5
Grammar Is a System That Characterizes Talk in Interaction.语法是一种描述互动性话语的系统。
Front Psychol. 2016 Dec 22;7:1938. doi: 10.3389/fpsyg.2016.01938. eCollection 2016.
6
Linking language to the visual world: Neural correlates of comprehending verbal reference to objects through pointing and visual cues.将语言与视觉世界相联系：通过指示和视觉线索理解对物体的言语指称的神经关联。
Neuropsychologia. 2017 Jan 27;95:21-29. doi: 10.1016/j.neuropsychologia.2016.12.004. Epub 2016 Dec 6.
7
Reflections on the "gesture-first" hypothesis of language origins.关于语言起源的“手势优先”假说的思考。
Psychon Bull Rev. 2017 Feb;24(1):163-170. doi: 10.3758/s13423-016-1117-3.
8
Hand gestures as visual prosody: BOLD responses to audio-visual alignment are modulated by the communicative nature of the stimuli.手势作为视觉韵律：对视听对齐的大脑反应强度受刺激的交际性质的调节。
Neuroimage. 2016 May 15;132:129-137. doi: 10.1016/j.neuroimage.2016.02.018. Epub 2016 Feb 15.
9
Depicting as a method of communication.描绘作为一种交流方式。
Psychol Rev. 2016 Apr;123(3):324-47. doi: 10.1037/rev0000026. Epub 2016 Feb 8.
10
Gesture, sign, and language: The coming of age of sign language and gesture studies.手势、符号和语言：手语和手势研究的时代到来。
Behav Brain Sci. 2017 Jan;40:e46. doi: 10.1017/S0140525X15001247. Epub 2015 Oct 5.
Zotero 插件