IEEE Trans Image Process. 2014 Dec;23(12):4996-5006. doi: 10.1109/TIP.2014.2359374. Epub 2014 Sep 19.
The speed of optical flow algorithm is crucial for many video editing tasks such as slow motion synthesis, selection propagation, tone adjustment propagation, and so on. Variational coarse-to-fine optical flow algorithms can generally produce high-quality results but cannot fulfil the speed requirement of many practical applications. Besides, large motions in real-world videos also pose a difficult problem to coarse-to-fine variational approaches. We, in this paper, present a fast optical flow algorithm that can handle large displacement motions. Our algorithm is inspired by recent successes of local methods in visual correspondence searching as well as approximate nearest neighbor field algorithms. The main novelty is a fast randomized edge-preserving approximate nearest neighbor field algorithm, which propagates self-similarity patterns in addition to offsets. Experimental results on public optical flow benchmarks show that our method is significantly faster than state-of-the-art methods without compromising on quality, especially when scenes contain large motions. Finally, we show some demo applications by applying our technique into real-world video editing tasks.
光流算法的速度对于许多视频编辑任务至关重要,例如慢动作合成、选区传播、色调调整传播等。变分由粗到精的光流算法通常可以产生高质量的结果,但无法满足许多实际应用的速度要求。此外,真实世界视频中的大运动也给由粗到精的变分方法带来了难题。本文提出了一种能够处理大位移运动的快速光流算法。我们的算法受到最近在视觉对应搜索以及近似最近邻场算法方面的局部方法成功的启发。主要的新颖之处在于一种快速的随机边缘保持近似最近邻场算法,它不仅传播偏移量,还传播自相似模式。在公共光流基准上的实验结果表明,我们的方法在不影响质量的情况下,比最先进的方法快得多,特别是在场景包含大运动时。最后,我们通过将我们的技术应用于现实世界的视频编辑任务来展示一些演示应用。