Zhou Yuan, Du Xiaoting, Wang Mingfei, Huo Shuwei, Zhang Yeda, Kung Sun-Yuan
IEEE Trans Cybern. 2022 Jul;52(7):5855-5867. doi: 10.1109/TCYB.2020.3044374. Epub 2022 Jul 4.
In general, image restoration involves mapping from low-quality images to their high-quality counterparts. Such optimal mapping is usually nonlinear and learnable by machine learning. Recently, deep convolutional neural networks have proven promising for such learning processing. It is desirable for an image processing network to support well with three vital tasks, namely: 1) super-resolution; 2) denoising; and 3) deblocking. It is commonly recognized that these tasks have strong correlations, which enable us to design a general framework to support all tasks. In particular, the selection of feature scales is known to significantly impact the performance on these tasks. To this end, we propose the cross-scale residual network to exploit scale-related features among the three tasks. The proposed network can extract spatial features across different scales and establish cross-temporal feature reusage, so as to handle different tasks in a general framework. Our experiments show that the proposed approach outperforms state-of-the-art methods in both quantitative and qualitative evaluations for multiple image restoration tasks.
一般来说,图像恢复涉及从低质量图像映射到高质量图像。这种最优映射通常是非线性的,并且可以通过机器学习来学习。最近,深度卷积神经网络已被证明在这种学习处理方面很有前景。一个图像处理网络最好能很好地支持三项重要任务,即:1)超分辨率;2)去噪;3)去块效应。人们普遍认识到这些任务具有很强的相关性,这使我们能够设计一个通用框架来支持所有任务。特别是,已知特征尺度的选择会显著影响这些任务的性能。为此,我们提出了跨尺度残差网络,以利用这三项任务之间与尺度相关的特征。所提出的网络可以跨不同尺度提取空间特征并建立跨时间的特征重用,从而在一个通用框架中处理不同任务。我们的实验表明,在多个图像恢复任务的定量和定性评估中,所提出的方法优于现有方法。