Mahmoud Gamal M, Said Wael, Fadel Magdy M, Elbaz Mostafa
Department of Electrical Engineering, Pharos University in Alexandria, Alexandria, Egypt.
Computer Science Department, Faculty of Computers and Informatics, Zagazig University, Zagazig, 44511, Egypt.
Sci Rep. 2025 Jan 7;15(1):1102. doi: 10.1038/s41598-024-82242-9.
Missing pixel imputation is a critical task in image processing, where the presence of high percentages of missing pixels can significantly degrade the performance of downstream tasks such as image segmentation and object detection. This paper introduces a novel approach for missing pixel imputation based on Generative Adversarial Networks (GANs). We propose a new GAN architecture incorporating an identity module and a sperm motility-inspired heuristic during filtration to optimize the selection of pixels used in reconstructing missing data. The intelligent sperm motility heuristic navigates the image's pixel space, identifying the most influential neighboring pixels for accurate imputation. Our approach includes three essential modifications: (1) integration of an identity module within the GAN architecture to mitigate the vanishing gradient problem; (2) introduction of a metaheuristic algorithm based on sperm motility to select the top 10 pixels that most effectively contribute to the generation of the missing pixel; and (3) the implementation of an adaptive interval mechanism between the discriminator's actual value and the weighted average of the selected pixels, enhancing the generator's efficiency and ensuring the coherence of the imputed pixels with the surrounding image context. We evaluate the proposed method on three distinct datasets (Energy Images, NREL Solar Images, and NREL Wind Turbine Dataset), demonstrating its superior performance in maintaining pixel integrity during the imputation process. Our experiments also confirm the approach's effectiveness in addressing everyday challenges in GANs, such as mode collapse and vanishing gradients, across various GAN architectures.
缺失像素插补是图像处理中的一项关键任务,其中高比例的缺失像素会显著降低诸如图像分割和目标检测等下游任务的性能。本文介绍了一种基于生成对抗网络(GAN)的新型缺失像素插补方法。我们提出了一种新的GAN架构,在过滤过程中纳入了一个恒等模块和一种受精子活力启发的启发式方法,以优化用于重建缺失数据的像素选择。智能精子活力启发式方法在图像的像素空间中导航,识别最具影响力的相邻像素以进行准确插补。我们的方法包括三个重要修改:(1)在GAN架构中集成恒等模块以减轻梯度消失问题;(2)引入基于精子活力的元启发式算法来选择对缺失像素生成最有效贡献的前10个像素;(3)在判别器的实际值与所选像素的加权平均值之间实现自适应间隔机制,提高生成器的效率并确保插补像素与周围图像上下文的一致性。我们在三个不同的数据集(能源图像、美国国家可再生能源实验室太阳能图像和美国国家可再生能源实验室风力涡轮机数据集)上评估了所提出的方法,证明了其在插补过程中保持像素完整性方面的卓越性能。我们的实验还证实了该方法在解决各种GAN架构中GAN的日常挑战(如模式坍塌和梯度消失)方面的有效性。