Institute of Data Science, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Korea.
Sensors (Basel). 2022 Mar 23;22(7):2474. doi: 10.3390/s22072474.
When using drone-based aerial images for panoramic image generation, the unstableness of the shooting angle often deteriorates the quality of the resulting image. To prevent these polluting effects from affecting the stitching process, this study proposes deep learning-based outlier rejection schemes that apply the architecture of the generative adversarial network (GAN) to reduce the falsely estimated hypothesis relating to a transform produced by a given baseline method, such as the random sample consensus method (RANSAC). To organize the training dataset, we obtain rigid transforms to resample the images via the operation of RANSAC for the correspondences produced by the scale-invariant feature transform descriptors. In the proposed method, the discriminator of GAN makes a pre-judgment of whether the estimated target hypothesis sample produced by RANSAC is true or false, and it recalls the generator to confirm the authenticity of the discriminator's inference by comparing the differences between the generated samples and the target sample. We have tested the proposed method for drone-based aerial images and some miscellaneous images. The proposed method has been shown to have relatively stable and good performances even in receiver-operated tough conditions.
当使用基于无人机的航空图像生成全景图像时,拍摄角度的不稳定性往往会降低生成图像的质量。为了防止这些污染效应影响拼接过程,本研究提出了基于深度学习的异常值拒绝方案,该方案应用生成对抗网络(GAN)的架构来减少与给定基线方法(如随机抽样一致方法(RANSAC))产生的变换相关的错误估计假设。为了组织训练数据集,我们通过 RANSAC 操作获得刚体变换,以便对由尺度不变特征变换描述符生成的对应点进行重采样。在提出的方法中,GAN 的鉴别器对 RANSAC 生成的目标假设样本的真假进行预先判断,并通过比较生成样本和目标样本之间的差异,召回生成器来确认鉴别器推断的真实性。我们已经对基于无人机的航空图像和一些杂项图像进行了测试。即使在接收者操作苛刻的条件下,该方法也表现出相对稳定和良好的性能。