Kwabla William, Dinc Furkan, Oumimoun Khalil, Kockara Sinan, Halic Tansel, Demirel Doga, Arikatla Sreekanth, Ahmadi Shahryar
University of Central Arkansas, Conway, Arkansas, USA.
Lamar University, Beaumont, Texas, USA.
Learn Collab Technol II (2023). 2023 Jul;14041:127-143. doi: 10.1007/978-3-031-34550-0_9. Epub 2023 Jun 9.
Web Real-Time Communication (WebRTC) is an open-source technology which enables remote peer-to-peer video and audio connection. It has quickly become the new standard for real-time communications over the web and is commonly used as a video conferencing platform. In this study, we present a different application domain which may greatly benefit from WebRTC technology, that is virtual reality (VR) based surgical simulations. Virtual Rotator Cuff Arthroscopic Skill Trainer (ViRCAST) is our testing platform that we completed preliminary feasibility studies for WebRTC. Since the elasticity of cloud computing provides the ability to meet possible future hardware/software requirements and demand growth, ViRCAST is deployed in a cloud environment. Additionally, in order to have plausible simulations and interactions, any VR-based surgery simulator must have haptic feedback. Therefore, we implemented an interface to WebRTC for integrating haptic devices. We tested ViRCAST on Google cloud through haptic-integrated WebRTC at various client configurations. Our experiments showed that WebRTC with cloud and haptic integrations is a feasible solution for VR-based surgery simulators. From our experiments, the WebRTC integrated simulation produced an average frame rate of 33 fps, and the hardware integration produced an average lag of 0.7 milliseconds in real-time.
网络实时通信(WebRTC)是一种开源技术,可实现远程点对点视频和音频连接。它已迅速成为网络实时通信的新标准,并通常用作视频会议平台。在本研究中,我们展示了一个可能从WebRTC技术中大大受益的不同应用领域,即基于虚拟现实(VR)的手术模拟。虚拟肩袖关节镜技能训练器(ViRCAST)是我们为WebRTC完成初步可行性研究的测试平台。由于云计算的弹性提供了满足未来可能的硬件/软件要求和需求增长的能力,ViRCAST部署在云环境中。此外,为了进行合理的模拟和交互,任何基于VR的手术模拟器都必须具有触觉反馈。因此,我们实现了一个用于WebRTC的接口,以集成触觉设备。我们通过在各种客户端配置下进行触觉集成的WebRTC在谷歌云上测试了ViRCAST。我们的实验表明,集成了云和触觉的WebRTC是基于VR的手术模拟器的可行解决方案。从我们的实验来看,如果将WebRTC集成到模拟中,平均帧率为33帧/秒,而硬件集成在实时情况下平均延迟为0.7毫秒。
Learn Collab Technol II (2023). 2023-7
AMIA Jt Summits Transl Sci Proc. 2022
Int J Comput Assist Radiol Surg. 2022-10
J Surg Res. 2009-10
Neurosurgery. 2013-1
Philos Trans R Soc Lond B Biol Sci. 2011-1-27
Knee Surg Sports Traumatol Arthrosc. 2009-7-24