Zheng Qingqing, Wang Yi, Heng Pheng Ann
IEEE Trans Image Process. 2019 Jul;28(7):3383-3394. doi: 10.1109/TIP.2019.2896528. Epub 2019 Jan 31.
Robust and efficient image alignment remains a challenging task, due to the massiveness of images, great illumination variations between images, partial occlusion, and corruption. To address these challenges, we propose an online image alignment method via subspace learning from image gradient orientations (IGOs). The proposed method integrates the subspace learning, transformed the IGO reconstruction and image alignment into a unified online framework, which is robust for aligning images with severe intensity distortions. Our method is motivated by a principal component analysis (PCA) from gradient orientations that provides more reliable low-dimensional subspace than that from pixel intensities. Instead of processing in the intensity-domain-like conventional methods, we seek alignment in the IGO domain, such that the aligned IGO of the newly arrived image can be decomposed as the sum of a sparse error and a linear composition of the IGO-PCA basis learned from previously well-aligned ones. The optimization problem is tackled by an iterative linearization that minimizes the l -norm of the sparse error. Furthermore, the IGO-PCA basis is adaptively updated based on incremental thin singular value decomposition, which takes the shift of IGO mean into consideration. The efficacy of the proposed method is validated on the extensive challenging datasets through image alignment, medical atlas construction, and face recognition. The experimental results demonstrate that our algorithm provides more illumination- and occlusion-robust image alignment than the state-of-the-art methods.
由于图像数量巨大、图像间光照变化大、部分遮挡以及图像损坏等问题,鲁棒且高效的图像对齐仍然是一项具有挑战性的任务。为应对这些挑战,我们提出一种通过从图像梯度方向(IGO)进行子空间学习的在线图像对齐方法。所提出的方法集成了子空间学习,将IGO重建和图像对齐转化为一个统一的在线框架,该框架对于对齐具有严重强度失真的图像具有鲁棒性。我们的方法受到基于梯度方向的主成分分析(PCA)的启发,与基于像素强度的PCA相比,它能提供更可靠的低维子空间。与传统方法在强度域进行处理不同,我们在IGO域中寻找对齐方式,使得新到达图像的对齐IGO可以分解为稀疏误差与从先前已良好对齐图像中学习到的IGO-PCA基的线性组合之和。通过迭代线性化解决优化问题,该迭代线性化使稀疏误差的l范数最小化。此外,基于增量薄奇异值分解自适应更新IGO-PCA基,其中考虑了IGO均值的偏移。通过图像对齐、医学图谱构建和人脸识别,在广泛的具有挑战性的数据集上验证了所提出方法的有效性。实验结果表明,我们的算法比现有方法提供了更具光照和遮挡鲁棒性的图像对齐。