School of Control and Computer Engineering, North China Electric Power University, Baoding, Hebei, China.
92524 troops, Ningbo, Zhejiang, China.
PLoS One. 2019 Apr 11;14(4):e0214852. doi: 10.1371/journal.pone.0214852. eCollection 2019.
In this paper, we put forward a real-time multiple GPUs (multi-GPU) accelerated virtual-reality interaction simulation framework where the reconstructed objects from camera images interact with virtual deformable objects. Firstly, based on an extended voxel-based visual hull (VbVH) algorithm, we design an image-based 3D reconstruction platform for real objects. Then, an improved hybrid deformation model, which couples the geometry constrained fast lattice shape matching method (FLSM) and total Lagrangian explicit dynamics (TLED) algorithm, is proposed to achieve efficient and stable simulation of the virtual objects' elastic deformations. Finally, one-way virtual-reality interactions including soft tissues' virtual cutting with bleeding effects are successfully simulated. Moreover, with the purpose of significantly improving the computational efficiency of each time step, we propose an entire multi-GPU implementation method of the framework using compute unified device architecture (CUDA). The experiment results demonstrate that our multi-GPU accelerated virtual-reality interaction framework achieves real-time performance under the moderate calculation scale, which is a new effective 3D interaction technique for virtual reality applications.
在本文中，我们提出了一个实时多 GPU（多 GPU）加速的虚拟现实交互模拟框架，其中来自相机图像的重构对象与虚拟可变形对象相互作用。首先，基于扩展的体素基视觉外壳（VbVH）算法，我们设计了一个用于真实对象的基于图像的 3D 重建平台。然后，提出了一种改进的混合变形模型，该模型结合了几何约束快速晶格形状匹配方法（FLSM）和全拉格朗日显式动力学（TLED）算法，以实现虚拟对象的弹性变形的高效和稳定模拟。最后，成功模拟了单向虚拟现实交互，包括具有出血效果的软组织虚拟切割。此外，为了显著提高每个时间步的计算效率，我们提出了一种使用计算统一设备架构（CUDA）的框架的完整多 GPU 实现方法。实验结果表明，我们的多 GPU 加速虚拟现实交互框架在中等计算规模下实现了实时性能，这是虚拟现实应用的一种新的有效 3D 交互技术。
