Andrist Sean, Collier Wesley, Gleicher Michael, Mutlu Bilge, Shaffer David
Department of Computer Sciences, University of Wisconsin-Madison Madison, WI, USA.
Department of Educational Psychology, University of Wisconsin-Madison Madison, WI, USA.
Front Psychol. 2015 Jul 21;6:1016. doi: 10.3389/fpsyg.2015.01016. eCollection 2015.
When conversing and collaborating in everyday situations, people naturally and interactively align their behaviors with each other across various communication channels, including speech, gesture, posture, and gaze. Having access to a partner's referential gaze behavior has been shown to be particularly important in achieving collaborative outcomes, but the process in which people's gaze behaviors unfold over the course of an interaction and become tightly coordinated is not well understood. In this paper, we present work to develop a deeper and more nuanced understanding of coordinated referential gaze in collaborating dyads. We recruited 13 dyads to participate in a collaborative sandwich-making task and used dual mobile eye tracking to synchronously record each participant's gaze behavior. We used a relatively new analysis technique-epistemic network analysis-to jointly model the gaze behaviors of both conversational participants. In this analysis, network nodes represent gaze targets for each participant, and edge strengths convey the likelihood of simultaneous gaze to the connected target nodes during a given time-slice. We divided collaborative task sequences into discrete phases to examine how the networks of shared gaze evolved over longer time windows. We conducted three separate analyses of the data to reveal (1) properties and patterns of how gaze coordination unfolds throughout an interaction sequence, (2) optimal time lags of gaze alignment within a dyad at different phases of the interaction, and (3) differences in gaze coordination patterns for interaction sequences that lead to breakdowns and repairs. In addition to contributing to the growing body of knowledge on the coordination of gaze behaviors in joint activities, this work has implications for the design of future technologies that engage in situated interactions with human users.
在日常情境中进行交流与合作时，人们会自然且交互地使彼此的行为在包括言语、手势、姿势和注视等各种沟通渠道上保持一致。研究表明，了解伙伴的指示性注视行为对于实现协作成果尤为重要，但人们的注视行为在互动过程中如何展开并紧密协调的过程尚不清楚。在本文中，我们开展了相关工作，以更深入、更细致地理解合作二元组中的协调性指示性注视。我们招募了13个二元组参与一项协作制作三明治的任务，并使用双移动眼动追踪技术同步记录每个参与者的注视行为。我们使用了一种相对较新的分析技术——认知网络分析——来联合建模两位对话参与者的注视行为。在这种分析中，网络节点代表每个参与者的注视目标，边的强度表示在给定时间片内同时注视相连目标节点的可能性。我们将协作任务序列划分为离散阶段，以研究共享注视网络在更长时间窗口内是如何演变的。我们对数据进行了三项独立分析，以揭示：（1）注视协调在整个互动序列中如何展开的特性和模式；（2）在互动的不同阶段，二元组内注视对齐的最佳时间滞后；（3）导致互动中断和修复的互动序列中注视协调模式的差异。除了为关于联合活动中注视行为协调的知识体系不断发展做出贡献外，这项工作还对与人类用户进行情境互动的未来技术设计具有启示意义。
