Zhang Zhensong, Nie Yongwei, Sun Hanqiu, Zhang Qing, Lai Qiuxia, Li Guiqing, Xiao Mingyu
IEEE Trans Image Process. 2019 Sep 4. doi: 10.1109/TIP.2019.2938086.
We present a method for synopsizing multiple videos captured by a set of surveillance cameras with some overlapped field-of-views. Currently, object-based approaches that directly shift objects along the time axis are already able to compute compact synopsis results for multiple surveillance videos. The challenge is how to present the multiple synopsis results in a more compact and understandable way. Previous approaches show them side by side on the screen, which however is difficult for user to comprehend. In this paper, we solve the problem by joint object-shifting and camera view-switching. Firstly, we synchronize the input videos, and group the same object in different videos together. Then we shift the groups of objects along the time axis to obtain multiple synopsis videos. Instead of showing them simultaneously, we just show one of them at each time, and allow to switch among the views of different synopsis videos. In this view switching way, we obtain just a single synopsis results consisting of content from all the input videos, which is much easier for user to follow and understand. To obtain the best synopsis result, we construct a simultaneous object-shifting and view-switching optimization framework instead of solving them separately. We also present an alternative optimization strategy composed of graph cuts and dynamic programming to solve the unified optimization. Experiments demonstrate that our single synopsis video generated from multiple input videos is compact, complete, and easy to understand.
我们提出了一种用于综合由一组具有部分重叠视场的监控摄像机捕获的多个视频的方法。目前，基于对象的方法直接沿时间轴移动对象，已经能够为多个监控视频计算紧凑的概要结果。挑战在于如何以更紧凑且易于理解的方式呈现多个概要结果。先前的方法在屏幕上并排显示它们，然而这对用户来说难以理解。在本文中，我们通过联合对象移动和摄像机视角切换来解决该问题。首先，我们同步输入视频，并将不同视频中的相同对象分组在一起。然后我们沿时间轴移动对象组以获得多个概要视频。我们不是同时显示它们，而是每次只显示其中一个，并允许在不同概要视频的视角之间切换。通过这种视角切换方式，我们得到一个仅由所有输入视频的内容组成的单一概要结果，这对用户来说更容易跟进和理解。为了获得最佳的概要结果，我们构建了一个同时进行对象移动和视角切换的优化框架，而不是分别求解它们。我们还提出了一种由图割和动态规划组成的替代优化策略来解决统一优化问题。实验表明，我们从多个输入视频生成的单一概要视频紧凑、完整且易于理解。
