Zhu Qian, Lu Tao, Guo Shunan, Ma Xiaojuan, Yang Yalong
IEEE Trans Vis Comput Graph. 2025 Jan;31(1):591-601. doi: 10.1109/TVCG.2024.3456210. Epub 2024 Nov 25.
Composite visualization represents a widely embraced design that combines multiple visual representations to create an integrated view. However, the traditional approach of creating composite visualizations in immersive environments typically occurs asynchronously outside of the immersive space and is carried out by experienced experts. In this work, we aim to empower users to participate in the creation of composite visualization within immersive environments through embodied interactions. This could provide a flexible and fluid experience with immersive visualization and has the potential to facilitate understanding of the relationship between visualization views. We begin with developing a design space of embodied interactions to create various types of composite visualizations with the consideration of data relationships. Drawing inspiration from people's natural experience of manipulating physical objects, we design interactions based on the combination of 3D manipulations in immersive environments. Building upon the design space, we present a series of case studies showcasing the interaction to create different kinds of composite visualizations in virtual reality. Subsequently, we conduct a user study to evaluate the usability of the derived interaction techniques and user experience of creating composite visualizations through embodied interactions. We find that empowering users to participate in composite visualizations through embodied interactions enables them to flexibly leverage different visualization views for understanding and communicating the relationships between different views, which underscores the potential of several future application scenarios.
复合可视化是一种被广泛采用的设计,它结合了多种视觉表示形式以创建一个集成视图。然而,在沉浸式环境中创建复合可视化的传统方法通常是在沉浸式空间之外异步进行的,并且由经验丰富的专家执行。在这项工作中,我们旨在通过具身交互让用户能够在沉浸式环境中参与复合可视化的创建。这可以提供一种灵活流畅的沉浸式可视化体验,并有可能促进对可视化视图之间关系的理解。我们首先开发一个具身交互的设计空间,在考虑数据关系的情况下创建各种类型的复合可视化。从人们操纵物理对象的自然体验中汲取灵感,我们基于沉浸式环境中的3D操作组合来设计交互。基于这个设计空间,我们展示了一系列案例研究,展示了在虚拟现实中创建不同类型复合可视化的交互。随后,我们进行了一项用户研究,以评估所衍生的交互技术的可用性以及通过具身交互创建复合可视化的用户体验。我们发现,让用户通过具身交互参与复合可视化,使他们能够灵活地利用不同的可视化视图来理解和传达不同视图之间的关系,这突出了几个未来应用场景的潜力。