Lao Yizhen, Ait-Aider Omar
IEEE Trans Pattern Anal Mach Intell. 2021 Aug;43(8):2780-2793. doi: 10.1109/TPAMI.2020.2977644. Epub 2021 Jul 1.
In this article we study the adaptation of the concept of homography to Rolling Shutter (RS) images. This extension has never been clearly adressed despite the many roles played by the homography matrix in multi-view geometry. We first show that a direct point-to-point relationship on a RS pair can be expressed as a set of 3 to 8 atomic 3x3 matrices depending on the kinematic model used for the instantaneous-motion during image acquisition. We call this group of matrices the RS Homography. We then propose linear solvers for the computation of these matrices using point correspondences. Finally, we derive linear and closed form solutions for two famous problems in computer vision in the case of RS images: image stitching and plane-based relative pose computation. Extensive experiments with both synthetic and real data from public benchmarks show that the proposed methods outperform state-of-art techniques.
在本文中，我们研究单应性概念对卷帘快门（RS）图像的适应性。尽管单应性矩阵在多视图几何中发挥着诸多作用，但这种扩展从未得到清晰的阐述。我们首先表明，RS图像对之间的直接点对点关系可以根据图像采集期间瞬时运动所使用的运动学模型，被表示为一组3到8个原子3x3矩阵。我们将这组矩阵称为RS单应性。然后，我们提出了使用点对应来计算这些矩阵的线性求解器。最后，我们针对RS图像情况下计算机视觉中的两个著名问题，推导出线性和封闭形式的解：图像拼接和基于平面的相对姿态计算。对来自公共基准的合成数据和真实数据进行的大量实验表明，所提出的方法优于现有技术。
