IEEE Trans Image Process. 2016 Feb;25(2):740-55. doi: 10.1109/TIP.2015.2507942. Epub 2015 Dec 11.
Video synopsis is an effective technique to provide a compact representation of the original video by removing spatiotemporal redundancies and by preserving the essential activities. Most current approaches for video synopsis will cause collisions among objects, especially when the video is condensed much. In this paper, we present an approach for video synopsis to reduce the collisions. Our approach first shifts active objects along the time axis to compact the original video. Then, the sizes of the objects are reduced when collisions occur. Meanwhile, the geometric centroids of the objects will be kept unchanged to preserve the location information. Our contributions are threefold. First, an approach is proposed to decrease collisions in the synopsis video through reducing the sizes of the objects. Second, an optimization framework is developed to indicate the optimal time position and the appropriate reduction coefficient for each object. Finally, some metrics are proposed, and several experiments are carried out to evaluate the proposed approach. The experiments have demonstrated that the synopsis video produced by our approach has much fewer collisions while the compression ratio is high.
视频摘要技术是一种通过去除时空冗余并保留关键活动来提供原始视频紧凑表示的有效技术。目前大多数视频摘要方法在对视频进行大幅压缩时,都会导致对象之间发生碰撞。在本文中,我们提出了一种减少碰撞的视频摘要方法。我们的方法首先沿时间轴移动活动对象,以压缩原始视频。然后,当发生碰撞时,会减小对象的大小。同时,将保持对象的几何质心不变,以保留位置信息。我们的贡献有三点。首先,提出了一种通过减小对象的大小来减少摘要视频中碰撞的方法。其次,开发了一个优化框架,以指示每个对象的最佳时间位置和适当的减小系数。最后,提出了一些度量标准,并进行了一些实验来评估所提出的方法。实验表明,我们的方法生成的摘要视频在保持高压缩比的同时,碰撞更少。