Koppensteiner Markus, Stephan Pia, Jäschke Johannes Paul Michael
Department of Anthropology, University of Vienna, Vienna, Austria.
PLoS One. 2016 Mar 3;11(3):e0150610. doi: 10.1371/journal.pone.0150610. eCollection 2016.
People assign the artificial words takete and kiki to spiky, angular figures and the artificial words maluma and bouba to rounded figures. We examined whether such a cross-modal correspondence could also be found for human body motion. We transferred the body movements of speakers onto two-dimensional coordinates and created animated stick-figures based on this data. Then we invited people to judge these stimuli using the words takete-maluma, bouba-kiki, and several verbal descriptors that served as measures of angularity/smoothness. In addition to this we extracted the quantity of motion, the velocity of motion and the average angle between motion vectors from the coordinate data. Judgments of takete (and kiki) were related to verbal descriptors of angularity, a high quantity of motion, high velocity and sharper angles. Judgments of maluma (or bouba) were related to smooth movements, a low velocity, a lower quantity of motion and blunter angles. A forced-choice experiment during which we presented subsets with low and high rankers on our motion measures revealed that people preferably assigned stimuli displaying fast movements with sharp angles in motion vectors to takete and stimuli displaying slow movements with blunter angles in motion vectors to maluma. Results indicated that body movements share features with information inherent in words such as takete and maluma and that people perceive the body movements of speakers on the level of changes in motion direction (e.g., body moves to the left and then back to the right). Follow-up studies are needed to clarify whether impressions of angularity and smoothness have similar communicative values across different modalities and how this affects social judgments and person perception.
人们将人造词“takete”和“kiki”赋予有尖刺、有棱角的图形,将人造词“maluma”和“bouba”赋予圆形图形。我们研究了在人体运动方面是否也能发现这种跨模态对应关系。我们将说话者的身体动作转换到二维坐标上,并基于这些数据创建了动画简笔画。然后我们邀请人们使用“takete-maluma”“bouba-kiki”以及几个作为棱角/平滑度度量的语言描述词来评判这些刺激。除此之外,我们还从坐标数据中提取了运动量、运动速度以及运动向量之间的平均角度。对“takete”(和“kiki”)的评判与棱角的语言描述词、高运动量、高速度以及更尖锐的角度相关。对“maluma”(或“bouba”)的评判与平滑的动作、低速度、较低的运动量以及更钝的角度相关。一项强制选择实验中,我们展示了在运动度量方面排名低和高的子集,结果显示人们更倾向于将运动向量角度尖锐的快速运动刺激赋予“takete”,将运动向量角度较钝的缓慢运动刺激赋予“maluma”。结果表明身体动作与“takete”和“maluma”等词所固有的信息具有共同特征,并且人们在运动方向变化的层面上感知说话者的身体动作(例如,身体向左移动然后再向右移动)。需要后续研究来阐明棱角和平滑度的印象在不同模态中是否具有相似的交际价值,以及这如何影响社会判断和人物感知。