文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

BeHere:一种基于虚拟副本在程序任务中共享手势和虚拟形象的虚拟现实/增强现实远程协作系统。

BeHere: a VR/SAR remote collaboration system based on virtual replicas sharing gesture and avatar in a procedural task.

作者信息

Wang Peng, Wang Yue, Billinghurst Mark, Yang Huizhen, Xu Peng, Li Yanhong

机构信息

School of Advanced Manufacturing Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China.

Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand.

出版信息

Virtual Real. 2023;27(2):1409-1430. doi: 10.1007/s10055-023-00748-5. Epub 2023 Jan 13.


DOI:10.1007/s10055-023-00748-5
PMID:36686612
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9838545/
Abstract

UNLABELLED: In this paper, we focus on the significance of remote collaboration using virtual replicas, avatar, and gesture on a procedural task in industry; thus, we present a Virtual Reality (VR)/Spatial Augmented Reality (SAR) remote collaboration system, BeHere, based on 3D virtual replicas and sharing gestures and avatar. BeHere enables a remote expert in VR to guide a local worker in real-time to complete a procedural task in the real-world. For the remote VR site, we construct a 3D virtual environment using virtual replicas, and the user can manipulate them by using gestures in an intuitive interaction and see their partners' 3D virtual avatar. For the local site, we use SAR to enable the local worker to see instructions projected onto the real-world based on the shared virtual replicas and gestures. We conducted a formal user study to evaluate the prototype system in terms of performance, social presence, workload, and ranking and user preference. We found that the combination of visual cues of gestures, avatar, and virtual replicas plays a positive role in improving user experience, especially for remote VR users. More significantly, our study provides useful information and important design implications for further research on the use of gesture-, gaze- and avatar-based cues as well as virtual replicas in VR/AR remote collaboration on a procedural task in industry. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10055-023-00748-5.

摘要

未标注:在本文中,我们聚焦于在工业流程任务中使用虚拟副本、虚拟化身和手势进行远程协作的重要性;因此,我们提出了一种基于3D虚拟副本以及共享手势和虚拟化身的虚拟现实(VR)/空间增强现实(SAR)远程协作系统BeHere。BeHere使VR中的远程专家能够实时指导本地工人完成现实世界中的流程任务。对于远程VR站点,我们使用虚拟副本构建3D虚拟环境,用户可以通过直观交互中的手势来操纵它们,并看到其合作伙伴的3D虚拟化身。对于本地站点,我们使用SAR使本地工人能够基于共享的虚拟副本和手势看到投射到现实世界中的指令。我们进行了一项正式的用户研究,以在性能、社交临场感、工作量以及排名和用户偏好方面评估该原型系统。我们发现手势、虚拟化身和虚拟副本的视觉线索组合在改善用户体验方面发挥了积极作用,特别是对于远程VR用户。更重要的是,我们的研究为在工业流程任务的VR/AR远程协作中进一步研究使用基于手势、注视和虚拟化身的线索以及虚拟副本提供了有用信息和重要设计启示。 补充信息:在线版本包含可在10.1007/s10055-023-00748-5获取的补充材料。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/55dc5af7796c/10055_2023_748_Fig26_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/9cec8077b435/10055_2023_748_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/c0f51c6f5e4d/10055_2023_748_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/0a868b61bfba/10055_2023_748_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/03d8a9bfedfa/10055_2023_748_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/48dd25dcbe8f/10055_2023_748_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/16d08010ea9e/10055_2023_748_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/245ccd0d3c0e/10055_2023_748_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/63e5e27bb706/10055_2023_748_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/26d67f956663/10055_2023_748_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/b2b20f85df36/10055_2023_748_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/193b955d71ea/10055_2023_748_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/8d5926b7e718/10055_2023_748_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/244feed1fdd5/10055_2023_748_Fig13_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/71208706d022/10055_2023_748_Fig14_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/34267fce76f7/10055_2023_748_Fig15_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/bf2332123bdf/10055_2023_748_Fig16_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/1c22002694e0/10055_2023_748_Fig17_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/0e9ef17041ae/10055_2023_748_Fig18_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/00c78198dee2/10055_2023_748_Fig19_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/e6fa39bce46e/10055_2023_748_Fig20_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/9a3039c6cfee/10055_2023_748_Fig21_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/d3a95a347f43/10055_2023_748_Fig22_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/75b37ad34a7b/10055_2023_748_Fig23_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/03983b491965/10055_2023_748_Fig24_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/2964c4ef01c7/10055_2023_748_Fig25_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/55dc5af7796c/10055_2023_748_Fig26_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/9cec8077b435/10055_2023_748_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/c0f51c6f5e4d/10055_2023_748_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/0a868b61bfba/10055_2023_748_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/03d8a9bfedfa/10055_2023_748_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/48dd25dcbe8f/10055_2023_748_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/16d08010ea9e/10055_2023_748_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/245ccd0d3c0e/10055_2023_748_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/63e5e27bb706/10055_2023_748_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/26d67f956663/10055_2023_748_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/b2b20f85df36/10055_2023_748_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/193b955d71ea/10055_2023_748_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/8d5926b7e718/10055_2023_748_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/244feed1fdd5/10055_2023_748_Fig13_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/71208706d022/10055_2023_748_Fig14_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/34267fce76f7/10055_2023_748_Fig15_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/bf2332123bdf/10055_2023_748_Fig16_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/1c22002694e0/10055_2023_748_Fig17_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/0e9ef17041ae/10055_2023_748_Fig18_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/00c78198dee2/10055_2023_748_Fig19_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/e6fa39bce46e/10055_2023_748_Fig20_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/9a3039c6cfee/10055_2023_748_Fig21_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/d3a95a347f43/10055_2023_748_Fig22_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/75b37ad34a7b/10055_2023_748_Fig23_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/03983b491965/10055_2023_748_Fig24_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/2964c4ef01c7/10055_2023_748_Fig25_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/147b/9838545/55dc5af7796c/10055_2023_748_Fig26_HTML.jpg

相似文献

[1]
BeHere: a VR/SAR remote collaboration system based on virtual replicas sharing gesture and avatar in a procedural task.

Virtual Real. 2023

[2]
Using Virtual Replicas to Improve Mixed Reality Remote Collaboration.

IEEE Trans Vis Comput Graph. 2023-5

[3]
A Comparison Between Two Different Approaches for a Collaborative Mixed-Virtual Environment in Industrial Maintenance.

Front Robot AI. 2019-3-27

[4]
Augmented Virtual Teleportation for High-Fidelity Telecollaboration.

IEEE Trans Vis Comput Graph. 2020-5

[5]
A novel AR remote collaborative platform for sharing 2.5D gestures and gaze.

Int J Adv Manuf Technol. 2022

[6]
Help! I Need a Remote Guide in My Mixed Reality Collaborative Environment.

Front Robot AI. 2019-11-15

[7]
Effects of Avatar Transparency on Social Presence in Task-Centric Mixed Reality Remote Collaboration.

IEEE Trans Vis Comput Graph. 2023-11

[8]
Avatars for Teleconsultation: Effects of Avatar Embodiment Techniques on User Perception in 3D Asymmetric Telepresence.

IEEE Trans Vis Comput Graph. 2021-11

[9]
Can you notice my attention? A novel information vision enhancement method in MR remote collaborative assembly.

Int J Adv Manuf Technol. 2023-6-2

[10]
The impact of eye gaze on social interactions of females in virtual reality: The mediating role of the uncanniness of avatars and the moderating role of task type.

Heliyon. 2023-10-5

引用本文的文献

[1]
Three-Dimensional Point Cloud Applications, Datasets, and Compression Methodologies for Remote Sensing: A Meta-Survey.

Sensors (Basel). 2025-3-7

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索