IEEE Comput Graph Appl. 2022 Jan-Feb;42(1):73-83. doi: 10.1109/MCG.2021.3058129. Epub 2022 Jan 25.
Building upon the ideas of storytelling and explorable explanations, we introduce Talking Realities, a concept for producing data-driven interactive narratives in virtual reality. It combines an audio narrative with an immersive visualization to communicate analysis results. The narrative is automatically produced using template-based natural language generation and adapts to data and user interactions. The synchronized animation of visual elements in accordance with the audio connects the two representations. In addition, we discuss various modes of explanation ranging from fully guided tours to free exploration of the data. We demonstrate the applicability of our concept by developing a virtual reality visualization for air traffic data. Furthermore, generalizability is exhibited by sketching mock-ups for two more application scenarios in the context of information and scientific visualization.
基于故事讲述和可探索解释的思想，我们引入了“Talking Realities”，这是一种在虚拟现实中生成数据驱动的交互式叙述的概念。它结合了音频叙述和沉浸式可视化，以传达分析结果。叙述使用基于模板的自然语言生成自动生成，并根据数据和用户交互进行调整。视觉元素与音频同步的动画将这两种表示连接起来。此外，我们讨论了各种解释模式，从完全引导式的游览到对数据的自由探索。我们通过开发一个用于空中交通数据的虚拟现实可视化来展示我们概念的适用性。此外，通过在信息和科学可视化的背景下为另外两个应用场景勾勒出草图模型，展示了其可推广性。
