San Diego State University, University of California, San Diego, United States of America.
Acta Psychol (Amst). 2023 Jun;236:103923. doi: 10.1016/j.actpsy.2023.103923. Epub 2023 Apr 21.
For sign languages, transitional movements of the hands are fully visible and may be used to predict upcoming linguistic input. We investigated whether and how deaf signers and hearing nonsigners use transitional information to detect a target item in a string of either pseudosigns or grooming gestures, as well as whether motor imagery ability was related to this skill. Transitional information between items was either intact (Normal videos), digitally altered such that the hands were selectively blurred (Blurred videos), or edited to only show the frame prior to the transition which was frozen for the entire transition period, removing all transitional information (Static videos). For both pseudosigns and gestures, signers and nonsigners had faster target detection times for Blurred than Static videos, indicating similar use of movement transition cues. For linguistic stimuli (pseudosigns), only signers made use of transitional handshape information, as evidenced by faster target detection times for Normal than Blurred videos. This result indicates that signers can use their linguistic knowledge to interpret transitional handshapes to predict the upcoming signal. Signers and nonsigners did not differ in motor imagery abilities, but only non-signers exhibited evidence of using motor imagery as a prediction strategy. Overall, these results suggest that signers use transitional movement and handshape cues to facilitate sign recognition.
对于手语来说,手部的过渡运动是完全可见的,可以用来预测即将到来的语言输入。我们研究了聋人手语使用者和听力非手语使用者是否以及如何利用过渡信息来检测伪手语或梳理手势字符串中的目标项目,以及运动意象能力是否与这一技能相关。项目之间的过渡信息要么完整(正常视频),要么通过数字方式进行干扰,使手部被选择性地模糊(模糊视频),或者编辑成只显示过渡前的那一帧,该帧在整个过渡期间被冻结,从而去除所有过渡信息(静态视频)。对于伪手语和手势,无论是手语使用者还是非手语使用者,在模糊视频中的目标检测时间都比静态视频快,这表明他们对手部运动过渡线索的使用相似。对于语言刺激(伪手语),只有手语使用者利用了过渡手形信息,这从正常视频比模糊视频的目标检测时间更快这一结果中可以得到证明。这一结果表明,手语使用者可以利用他们的语言知识来解释过渡手形,从而预测即将到来的信号。手语使用者和非手语使用者在运动意象能力方面没有差异,但只有非手语使用者表现出使用运动意象作为预测策略的证据。总的来说,这些结果表明,手语使用者利用过渡运动和手形线索来促进手语识别。