Zha Bingxin, Yang Shengying, Lei Jingsheng, Xu Zhenyu, Ye Ning, Feng Boyang
School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, 310023, China.
School of Information Science and Technology, Zhejiang Shuren University, Hangzhou, 310015, China.
Sci Rep. 2024 Nov 14;14(1):28064. doi: 10.1038/s41598-024-79695-3.
In recent years, the field of face super-resolution (FSR) has advanced rapidly. However, complex degradation factors in real-world scenarios can severely deteriorate image quality, significantly affecting the reconstruction performance of FSR methods. Currently, there is a lack of research on degradation modeling for real-world facial images, which impacts the generalization ability of existing FSR methods. In this paper, a practical degradation model based on hybrid degradation processes is proposed to select multiple degradation processes including Gaussian noise, Rayleigh noise, Motion blur, Salt-and-Pepper noise, and Mean blur through a stochastic strategy to more realistically simulate the effect of image distortion in real scenarios. We also design a dual-branch attention network called DBANet for face super-resolution and conduct experiments on the SCUT_FBP, Helen and PFHQ datasets, achieving satisfactory results. Our proposed model is effective in handling image distortion under different degradation modalities, which improves the robustness of super-resolution reconstruction. This study introduces an innovative approach to the field of face image super-resolution, which has the potential for a wide range of practical applications. The code of DBANet will be available at https://github.com/bxzha/DBANet .
近年来,面部超分辨率(FSR)领域发展迅速。然而,现实场景中的复杂退化因素会严重降低图像质量,显著影响FSR方法的重建性能。目前,针对真实世界面部图像的退化建模研究不足,这影响了现有FSR方法的泛化能力。本文提出了一种基于混合退化过程的实用退化模型,通过随机策略选择包括高斯噪声、瑞利噪声、运动模糊、椒盐噪声和均值模糊在内的多种退化过程,以更真实地模拟真实场景中图像失真的效果。我们还设计了一种名为DBANet的双分支注意力网络用于面部超分辨率,并在SCUT_FBP、Helen和PFHQ数据集上进行了实验,取得了满意的结果。我们提出的模型在处理不同退化模式下的图像失真方面是有效的,提高了超分辨率重建的鲁棒性。本研究为面部图像超分辨率领域引入了一种创新方法,具有广泛的实际应用潜力。DBANet的代码将在https://github.com/bxzha/DBANet上提供。