IEEE Comput Graph Appl. 2022 Sep-Oct;42(5):51-65. doi: 10.1109/MCG.2022.3189034. Epub 2022 Oct 4.
In this article, we design and develop a 3-D virtual museum with holistic metadata documentation and a variety of reptile behaviors and movements. First, we reconstruct the reptile's mesh in high resolution, and then create its rigged/skinned digital counterpart. We acquire the movement of two subjects using an optical motion capture system, accelerometers, and RGB-vision cameras; these movements are then segmented and annotated to various behaviors. The 3-D environment, virtual reality (VR), and augmented reality (AR) functionalities of our online repository serve as tools for interactively educating the public on animals, which are difficult to observe and study in their natural environment. It also reveals important information regarding animals' intangible characteristics (e.g., behavior), that is critical for the preservation of wildlife. Our museum is publicly accessible, enabling motion data reusability, and facilitating learning applications through gamification. We conducted a user study that confirms the naturalness and realism of our reptiles, along with the ease of use and usefulness of our museum.
本文设计并开发了一个具有整体元数据文档和多种爬虫行为和运动的 3D 虚拟博物馆。首先,我们以高分辨率重建爬虫的网格,然后创建其装备/皮肤的数字对应物。我们使用光学运动捕捉系统、加速度计和 RGB 视觉摄像机获取两个主体的运动; 然后将这些运动分割并注释为各种行为。我们在线存储库的 3D 环境、虚拟现实 (VR) 和增强现实 (AR) 功能可作为互动式教育工具,让公众了解在自然环境中难以观察和研究的动物。它还揭示了有关动物无形特征(例如行为)的重要信息,这对于野生动物的保护至关重要。我们的博物馆对公众开放,允许重用运动数据,并通过游戏化促进学习应用。我们进行了一项用户研究,证实了我们的爬虫的自然性和真实性,以及我们博物馆的易用性和有用性。