McGarry Meghan E, Mott Megan, Midgley Katherine J, Holcomb Phillip J, Emmorey Karen
Joint Doctoral Program in Language and Communication Disorders, San Diego State University and University of California, San Diego, San Diego, CA USA.
Department of Psychology, San Diego State University, San Diego, CA USA.
Lang Cogn Neurosci. 2021;36(2):199-210. doi: 10.1080/23273798.2020.1804601. Epub 2020 Aug 19.
A picture-naming task and ERPs were used to investigate effects of iconicity and visual alignment between signs and pictures in American Sign Language (ASL). For iconic signs, half the pictures visually overlapped with phonological features of the sign (e.g., the fingers of CAT align with a picture of a cat with prominent whiskers), while half did not (whiskers are not shown). Iconic signs were produced numerically faster than non-iconic signs and were associated with larger N400 amplitudes, akin to concreteness effects. Pictures aligned with iconic signs were named faster than non-aligned pictures, and there was a reduction in N400 amplitude. No behavioral effects were observed for the control group (English speakers). We conclude that sensory-motoric semantic features are represented more robustly for iconic than non-iconic signs (eliciting a concreteness-like N400 effect) and visual overlap between pictures and the phonological form of iconic signs facilitates lexical retrieval (eliciting a reduced N400).
一项图片命名任务和事件相关电位（ERPs）被用于研究美国手语（ASL）中手势与图片之间的象似性和视觉对齐的影响。对于象似性手势，一半的图片在视觉上与手势的语音特征重叠（例如，“猫”的手指与一只长着突出胡须的猫的图片对齐），而另一半则没有（胡须未显示）。象似性手势的产生在数字上比非象似性手势更快，并且与更大的N400波幅相关，类似于具体性效应。与象似性手势对齐的图片比未对齐的图片命名更快，并且N400波幅减小。对照组（说英语的人）未观察到行为效应。我们得出结论，感觉运动语义特征在象似性手势中比在非象似性手势中表现得更强烈（引发类似具体性的N400效应），并且图片与象似性手势的语音形式之间的视觉重叠促进词汇检索（引发减小的N400）。
