Hangzhou Vocational and Technical College, Hangzhou, China.
PLoS One. 2023 Feb 24;18(2):e0280986. doi: 10.1371/journal.pone.0280986. eCollection 2023.
Previous general super-resolution methods do not perform well in restoring the details structure information of face images. Prior and attribute-based face super-resolution methods have improved performance with extra trained results. However, they need an additional network and extra training data are challenging to obtain. To address these issues, we propose a Multi-phase Attention Network (MPAN). Specifically, our proposed MPAN builds on integrated residual attention groups (IRAG) and a concatenated attention module (CAM). The IRAG consists of residual channel attention blocks (RCAB) and an integrated attention module (IAM). Meanwhile, we use IRAG to bootstrap the face structures. We utilize the CAM to concentrate on informative layers, hence improving the network's ability to reconstruct facial texture features. We use the IAM to focus on important positions and channels, which makes the network more effective at restoring key face structures like eyes and mouths. The above two attention modules form the multi-phase attention mechanism. Extensive experiments show that our MPAN has a significant competitive advantage over other state-of-the-art networks on various scale factors using various metrics, including PSNR and SSIM. Overall, our proposed Multi-phase Attention mechanism significantly improves the network for recovering face HR images without using additional information.
先前的通用超分辨率方法在恢复人脸图像的细节结构信息方面表现不佳。基于先验和属性的人脸超分辨率方法通过额外的训练结果提高了性能。然而,它们需要额外的网络,并且额外的训练数据难以获取。为了解决这些问题,我们提出了一种多阶段注意网络(MPAN)。具体来说,我们提出的 MPAN 基于集成残差注意组(IRAG)和串联注意模块(CAM)。IRAG 由残差通道注意块(RCAB)和集成注意模块(IAM)组成。同时,我们使用 IRAG 来引导人脸结构。我们利用 CAM 关注信息丰富的层,从而提高网络重建面部纹理特征的能力。我们利用 IAM 关注重要的位置和通道,这使得网络更有效地恢复眼睛和嘴巴等关键人脸结构。上述两个注意模块构成了多阶段注意机制。大量实验表明,我们的 MPAN 在使用各种指标(包括 PSNR 和 SSIM)的各种比例因子下,与其他最先进的网络相比具有显著的竞争优势。总的来说,我们提出的多阶段注意机制在不使用额外信息的情况下,显著提高了网络恢复人脸 HR 图像的能力。