Bashir Syed Muhammad Arsalan, Wang Yi, Khan Mahrukh, Niu Yilong
School of Electronics and Information, Northwestern Polytechnical University, Xi'an, Shaanxi, China.
Quality Assurance, Pakistan Space and Upper Atmosphere Research Commission, Karachi, Sindh, Pakistan.
PeerJ Comput Sci. 2021 Jul 13;7:e621. doi: 10.7717/peerj-cs.621. eCollection 2021.
Image super-resolution (SR) is one of the vital image processing methods that improve the resolution of an image in the field of computer vision. In the last two decades, significant progress has been made in the field of super-resolution, especially by utilizing deep learning methods. This survey is an effort to provide a detailed survey of recent progress in single-image super-resolution in the perspective of deep learning while also informing about the initial classical methods used for image super-resolution. The survey classifies the image SR methods into four categories, i.e., classical methods, supervised learning-based methods, unsupervised learning-based methods, and domain-specific SR methods. We also introduce the problem of SR to provide intuition about image quality metrics, available reference datasets, and SR challenges. Deep learning-based approaches of SR are evaluated using a reference dataset. Some of the reviewed state-of-the-art image SR methods include the enhanced deep SR network (EDSR), cycle-in-cycle GAN (CinCGAN), multiscale residual network (MSRN), meta residual dense network (Meta-RDN), recurrent back-projection network (RBPN), second-order attention network (SAN), SR feedback network (SRFBN) and the wavelet-based residual attention network (WRAN). Finally, this survey is concluded with future directions and trends in SR and open problems in SR to be addressed by the researchers.
图像超分辨率(SR)是计算机视觉领域中提高图像分辨率的重要图像处理方法之一。在过去二十年中,超分辨率领域取得了重大进展,特别是通过利用深度学习方法。本综述旨在从深度学习的角度对单图像超分辨率的最新进展进行详细综述,同时介绍用于图像超分辨率的初始经典方法。该综述将图像SR方法分为四类,即经典方法、基于监督学习的方法、基于无监督学习的方法和特定领域的SR方法。我们还介绍了SR问题,以提供有关图像质量指标、可用参考数据集和SR挑战的直观认识。基于深度学习的SR方法使用参考数据集进行评估。一些被综述的最新图像SR方法包括增强深度SR网络(EDSR)、循环循环GAN(CinCGAN)、多尺度残差网络(MSRN)、元残差密集网络(Meta-RDN)、递归反投影网络(RBPN)、二阶注意力网络(SAN)、SR反馈网络(SRFBN)和基于小波的残差注意力网络(WRAN)。最后,本综述以SR的未来方向和趋势以及研究人员有待解决的SR开放问题作为总结。