Department of Cognitive Science, Central European University, Budapest, Hungary; Institute for Sports Science, Leibniz Universität Hannover, Hannover, Germany.
Department of Cognitive Science, Central European University, Budapest, Hungary.
Acta Psychol (Amst). 2021 Jan;212:103222. doi: 10.1016/j.actpsy.2020.103222. Epub 2020 Dec 7.
When performing joint actions, people rely on common ground - shared information that provides the required basis for mutual understanding. Common ground can be based on people's interaction history or on knowledge and expectations people share, e.g., because they belong to the same culture or social class. Here, we suggest that people rely on yet another form of common ground, one that originates in their similarities in multisensory processing. Specifically, we focus on 'crossmodal correspondences' - nonarbitrary associations that people make between stimulus features in different sensory modalities, e.g., between stimuli in the auditory and the visual modality such as high-pitched sounds and small objects. Going beyond previous research that focused on investigating crossmodal correspondences in individuals, we propose that people can use these correspondences for communicating and coordinating with others. Initial support for our proposal comes from a communication game played in a public space (an art gallery) by pairs of visitors. We observed that pairs created nonverbal communication systems by spontaneously relying on 'crossmodal common ground'. Based on these results, we conclude that crossmodal correspondences not only occur within individuals but that they can also be actively used in joint action to facilitate the coordination between individuals.
在进行联合行动时，人们依赖共同基础——提供相互理解所需基础的共享信息。共同基础可以基于人们的互动历史，也可以基于人们共享的知识和期望，例如，因为他们属于同一文化或社会阶层。在这里，我们提出人们依赖另一种共同基础，这种共同基础源于他们在多感觉处理方面的相似性。具体来说，我们关注的是“跨模态对应”——人们在不同感觉模态之间对刺激特征做出的非任意关联，例如，在听觉和视觉模态之间的刺激，如高音和小物体。超越之前专注于研究个体跨模态对应关系的研究，我们提出人们可以利用这些对应关系与他人进行交流和协调。我们的建议最初得到了在公共空间（美术馆）中由成对访客进行的交流游戏的支持。我们观察到，成对的访客通过自发地依赖“跨模态共同基础”来创建非言语交流系统。基于这些结果，我们得出结论，跨模态对应不仅发生在个体内部，而且还可以在联合行动中被积极地用于促进个体之间的协调。
