Wang Peng, Wang Yue, Billinghurst Mark, Yang Huizhen, Xu Peng, Li Yanhong
School of Advanced Manufacturing Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China.
Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand.
Virtual Real. 2023;27(2):1409-1430. doi: 10.1007/s10055-023-00748-5. Epub 2023 Jan 13.
UNLABELLED: In this paper, we focus on the significance of remote collaboration using virtual replicas, avatar, and gesture on a procedural task in industry; thus, we present a Virtual Reality (VR)/Spatial Augmented Reality (SAR) remote collaboration system, BeHere, based on 3D virtual replicas and sharing gestures and avatar. BeHere enables a remote expert in VR to guide a local worker in real-time to complete a procedural task in the real-world. For the remote VR site, we construct a 3D virtual environment using virtual replicas, and the user can manipulate them by using gestures in an intuitive interaction and see their partners' 3D virtual avatar. For the local site, we use SAR to enable the local worker to see instructions projected onto the real-world based on the shared virtual replicas and gestures. We conducted a formal user study to evaluate the prototype system in terms of performance, social presence, workload, and ranking and user preference. We found that the combination of visual cues of gestures, avatar, and virtual replicas plays a positive role in improving user experience, especially for remote VR users. More significantly, our study provides useful information and important design implications for further research on the use of gesture-, gaze- and avatar-based cues as well as virtual replicas in VR/AR remote collaboration on a procedural task in industry. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10055-023-00748-5.
未标注:在本文中,我们聚焦于在工业流程任务中使用虚拟副本、虚拟化身和手势进行远程协作的重要性;因此,我们提出了一种基于3D虚拟副本以及共享手势和虚拟化身的虚拟现实(VR)/空间增强现实(SAR)远程协作系统BeHere。BeHere使VR中的远程专家能够实时指导本地工人完成现实世界中的流程任务。对于远程VR站点,我们使用虚拟副本构建3D虚拟环境,用户可以通过直观交互中的手势来操纵它们,并看到其合作伙伴的3D虚拟化身。对于本地站点,我们使用SAR使本地工人能够基于共享的虚拟副本和手势看到投射到现实世界中的指令。我们进行了一项正式的用户研究,以在性能、社交临场感、工作量以及排名和用户偏好方面评估该原型系统。我们发现手势、虚拟化身和虚拟副本的视觉线索组合在改善用户体验方面发挥了积极作用,特别是对于远程VR用户。更重要的是,我们的研究为在工业流程任务的VR/AR远程协作中进一步研究使用基于手势、注视和虚拟化身的线索以及虚拟副本提供了有用信息和重要设计启示。 补充信息:在线版本包含可在10.1007/s10055-023-00748-5获取的补充材料。
IEEE Trans Vis Comput Graph. 2023-5
IEEE Trans Vis Comput Graph. 2020-5
Int J Adv Manuf Technol. 2022
Front Robot AI. 2019-11-15
IEEE Trans Vis Comput Graph. 2023-11
IEEE Trans Vis Comput Graph. 2021-11
Int J Adv Manuf Technol. 2023-6-2