IEEE Trans Vis Comput Graph. 2024 Nov;30(11):7214-7224. doi: 10.1109/TVCG.2024.3456146. Epub 2024 Oct 10.
Virtual Reality (VR) has become an important tool for conducting behavioral studies in realistic, reproducible environments. In this paper, we present ISA, an Immersive Study Analyzer system designed for the comprehensive analysis of social VR studies. For in-depth analysis of participant behavior, ISA records all user actions, speech, and the contextual environment of social VR studies. A key feature is the ability to review and analyze such immersive recordings collaboratively in VR, through support of behavioral coding and user-defined analysis queries for efficient identification of complex behavior. Respatialization of the recorded audio streams enables analysts to follow study participants' conversations in a natural and intuitive way. To support phases of close and loosely coupled collaboration, ISA allows joint and individual temporal navigation, and provides tools to facilitate collaboration among users at different temporal positions. An expert review confirms that ISA effectively supports collaborative immersive analysis, providing a novel and effective tool for nuanced understanding of user behavior in social VR studies.
虚拟现实(VR)已经成为在真实、可重复的环境中进行行为研究的重要工具。在本文中,我们介绍了 ISA,这是一个沉浸式研究分析系统,旨在对社会 VR 研究进行全面分析。为了深入分析参与者的行为,ISA 记录了所有用户的动作、语音以及社会 VR 研究的上下文环境。一个关键功能是能够在 VR 中协作地审查和分析这种沉浸式记录,通过支持行为编码和用户定义的分析查询,以便有效地识别复杂行为。录制音频流的重定位使分析人员能够以自然和直观的方式跟踪研究参与者的对话。为了支持紧密和松散耦合协作的各个阶段,ISA 允许联合和单独的时间导航,并提供工具来促进不同时间位置的用户之间的协作。专家审查证实,ISA 有效地支持协作式沉浸式分析,为深入了解社会 VR 研究中的用户行为提供了一种新颖有效的工具。