Tang Tan, Li Renzhong, Wu Xinke, Liu Shuhan, Knittel Johannes, Koch Steffen, Yu Lingyun, Ren Peiran, Ertl Thomas, Wu Yingcai
IEEE Trans Vis Comput Graph. 2021 Feb;27(2):294-303. doi: 10.1109/TVCG.2020.3030467. Epub 2021 Jan 28.
Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to balance between aesthetic goals and narrative constraints. Despite that the optimization-based methods have been improved significantly in terms of producing aesthetic and legible layouts, the existing (semi-) automatic methods are still limited regarding 1) efficient exploration of the storyline design space and 2) flexible customization of storyline layouts. In this work, we propose a reinforcement learning framework to train an AI agent that assists users in exploring the design space efficiently and generating well-optimized storylines. Based on the framework, we introduce PlotThread, an authoring tool that integrates a set of flexible interactions to support easy customization of storyline visualizations. To seamlessly integrate the AI agent into the authoring process, we employ a mixed-initiative approach where both the agent and designers work on the same canvas to boost the collaborative design of storylines. We evaluate the reinforcement learning model through qualitative and quantitative experiments and demonstrate the usage of PlotThread using a collection of use cases.
故事情节可视化是呈现情节演变和揭示角色之间场景互动的有效手段。然而,故事情节可视化的设计是一项艰巨的任务,因为用户需要在美学目标和叙事约束之间取得平衡。尽管基于优化的方法在生成美观且易读的布局方面有了显著改进,但现有的(半)自动方法在以下方面仍然存在局限性:1)故事情节设计空间的高效探索;2)故事情节布局的灵活定制。在这项工作中,我们提出了一个强化学习框架来训练一个人工智能代理,该代理可帮助用户高效地探索设计空间并生成优化良好的故事情节。基于该框架,我们引入了PlotThread——一种创作工具,它集成了一组灵活的交互,以支持轻松定制故事情节可视化。为了将人工智能代理无缝集成到创作过程中,我们采用了一种混合主动方法,即代理和设计师在同一画布上工作,以促进故事情节的协同设计。我们通过定性和定量实验评估强化学习模型,并使用一系列用例展示PlotThread的用法。