Pimentel Daniel, Vinkers Charlotte
Oregon Reality Lab, School of Journalism and Communication, University of Oregon, Portland, OR, United States.
Magic Leap, Plantation, FL, United States.
Front Robot AI. 2021 Apr 12;8:634520. doi: 10.3389/frobt.2021.634520. eCollection 2021.
Virtual humans (VHs)-automated, three-dimensional agents-can serve as realistic embodiments for social interactions with human users. Extant literature suggests that a user's cognitive and affective responses toward a VH depend on the extent to which the interaction elicits a sense of copresence, or the subjective "sense of being together." Furthermore, prior research has linked copresence to important social outcomes (e.g., likeability and trust), emphasizing the need to understand which factors contribute to this psychological state. Although there is some understanding of the determinants of copresence in virtual reality (VR) (cf. Oh et al., 2018), it is less known what determines copresence in mixed reality (MR), a modality wherein VHs have unique access to social cues in a "real-world" setting. In the current study, we examined the extent to which a VH's responsiveness to events occurring in the user's physical environment increased a sense of copresence and heightened affective connections to the VH. Participants ( = 65) engaged in two collaborative tasks with a (nonspeaking) VH using an MR headset. In the first task, no event in the participant's physical environment would occur, which served as the control condition. In the second task, an event in the participants' physical environment occurred, to which the VH either responded or ignored depending on the experimental condition. Copresence and interpersonal evaluations of the VHs were measured after each collaborative task self-reported measures. Results show that when the VH responded to the physical event, participants experienced a significant stronger sense of copresence than when the VH did not respond. However, responsiveness did not elicit more positive evaluations toward the VH (likeability and emotional connectedness). This study is an integral first step in establishing how and when affective and cognitive components of evaluations during social interactions diverge. Importantly, the findings suggest that feeling copresence with VH in MR is partially determined by the VHs' response to events in the actual physical environment shared by both interactants.
虚拟人(VHs)——自动化的三维智能体——可以作为与人类用户进行社交互动的逼真化身。现有文献表明,用户对虚拟人的认知和情感反应取决于互动引发共在感的程度,即主观的“在一起的感觉”。此外,先前的研究已将共在感与重要的社会结果(如喜爱度和信任)联系起来,强调需要了解哪些因素促成这种心理状态。虽然对虚拟现实(VR)中共在感的决定因素有一定了解(参见Oh等人,2018),但对于混合现实(MR)中共在感的决定因素知之甚少,在这种模式下,虚拟人在“现实世界”环境中能够独特地获取社交线索。在本研究中,我们考察了虚拟人对用户物理环境中发生的事件的反应程度在多大程度上增强了共在感,并加深了与虚拟人的情感联系。参与者(n = 65)使用混合现实头显与一个(不说话的)虚拟人进行了两项协作任务。在第一项任务中,参与者物理环境中不会发生任何事件,这作为对照条件。在第二项任务中,参与者物理环境中发生了一个事件,虚拟人根据实验条件对该事件做出反应或忽略。在每项协作任务后,通过自我报告测量法测量了共在感和对虚拟人的人际评价。结果表明,当虚拟人对物理事件做出反应时,参与者体验到的共在感显著强于虚拟人不做出反应时。然而,反应性并未引发对虚拟人更积极的评价(喜爱度和情感连接)。本研究是确定社交互动中评价的情感和认知成分如何以及何时出现差异的重要第一步。重要的是,研究结果表明,在混合现实中与虚拟人产生共在感部分取决于虚拟人对互动双方共享的实际物理环境中事件的反应。