Abney Drew H, Dale Rick, Louwerse Max M, Kello Christopher T
Department of Psychological and Brain Sciences, Indiana University.
Department of Communication, University of California, Los Angeles.
Cogn Sci. 2018 May;42(4):1297-1316. doi: 10.1111/cogs.12612. Epub 2018 Apr 6.
Recent studies of naturalistic face-to-face communication have demonstrated coordination patterns such as the temporal matching of verbal and non-verbal behavior, which provides evidence for the proposal that verbal and non-verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non-verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, ), we focus on measuring the temporal patterns of specific communicative behaviors in terms of their burstiness. We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non-verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non-verbal channels. We propose a "temporal heterogeneity" hypothesis to explain how the language system adapts to the demands of dialog.
近期对自然主义面对面交流的研究已经证明了一些协调模式，比如言语和非言语行为的时间匹配，这为言语和非言语交际控制源自一个系统的提议提供了证据。在本研究中，我们认为观察到的言语和非言语行为之间的关系取决于分析层面。在对一个自然主义多模态交流语料库（Louwerse、Dale、Bard和Jeuniaux， ）的重新分析中，我们专注于根据特定交际行为的突发性来测量其时间模式。我们检查了不同说话者角色和不同交际模态下的突发性估计。我们观察到，与非言语通道相比，言语通道的突发性更强；与信息性较弱的语言子通道相比，信息性较强的语言子通道的突发性更强。使用这种分析交际行为时间模式的新方法，我们表明言语和非言语通道之间存在复杂的关系。我们提出一个“时间异质性”假设来解释语言系统如何适应对话的需求。
