Huang Yuanfei, Li Jie, Hu Yanting, Gao Xinbo, Huang Hua
IEEE Trans Pattern Anal Mach Intell. 2023 May;45(5):6495-6510. doi: 10.1109/TPAMI.2022.3206870. Epub 2023 Apr 3.
Being extremely dependent on iterative estimation of the degradation prior or optimization of the model from scratch, the existing blind super-resolution (SR) methods are generally time-consuming and less effective, as the estimation of degradation proceeds from a blind initialization and lacks interpretable representation of degradations. To address it, this article proposes a transitional learning method for blind SR using an end-to-end network without any additional iterations in inference, and explores an effective representation for unknown degradation. To begin with, we analyze and demonstrate the transitionality of degradations as interpretable prior information to indirectly infer the unknown degradation model, including the widely used additive and convolutive degradations. We then propose a novel Transitional Learning method for blind Super-Resolution (TLSR), by adaptively inferring a transitional transformation function to solve the unknown degradations without any iterative operations in inference. Specifically, the end-to-end TLSR network consists of a degree of transitionality (DoT) estimation network, a homogeneous feature extraction network, and a transitional learning module. Quantitative and qualitative evaluations on blind SR tasks demonstrate that the proposed TLSR achieves superior performances and costs fewer complexities against the state-of-the-art blind SR methods. The code is available at github.com/YuanfeiHuang/TLSR.
现有的盲超分辨率(SR)方法极度依赖于对退化先验的迭代估计或从头开始对模型进行优化,通常既耗时又效率低下,因为退化估计是从盲目初始化开始的,并且缺乏对退化的可解释表示。为了解决这个问题,本文提出了一种用于盲SR的过渡学习方法,该方法使用端到端网络,在推理过程中无需任何额外的迭代,并探索了一种用于未知退化的有效表示。首先,我们分析并证明退化的过渡性作为可解释的先验信息,以间接推断未知的退化模型,包括广泛使用的加性和卷积性退化。然后,我们提出了一种新颖的用于盲超分辨率的过渡学习(TLSR)方法,通过自适应推断过渡变换函数来解决未知退化问题,在推理过程中无需任何迭代操作。具体而言,端到端的TLSR网络由过渡度(DoT)估计网络、同质特征提取网络和过渡学习模块组成。对盲SR任务的定量和定性评估表明,与现有最先进的盲SR方法相比,所提出的TLSR具有卓越的性能且复杂度更低。代码可在github.com/YuanfeiHuang/TLSR获取。