College of Electronic Information and Physics, Central South University of Forestry and Technology, Changsha, 41004, Hunan, China.
College of Systems Engineering, National University of Defense Technology, Changsha, 410000, Hunan, China.
Plant J. 2024 Nov;120(4):1278-1303. doi: 10.1111/tpj.17042. Epub 2024 Oct 24.
The use of deep learning techniques to identify grape leaf diseases relies on large, high-quality datasets. However, a large number of images occupy more computing resources and are prone to pattern collapse during training. In this paper, a depth-separable multifeature generative adversarial network (DMFGAN) was proposed to enhance grape leaf disease data. First, a multifeature extraction block (MFEB) based on the four-channel feature fusion strategy is designed to improve the quality of the generated image and avoid the problem of poor feature learning ability of the adversarial generation network caused by the single-channel feature extraction method. Second, a depth-based D-discriminator is designed to improve the discriminator capability and reduce the number of model parameters. Third, SeLU activation function was substituted for DCGAN activation function to overcome the problem that DCGAN activation function was not enough to fit grape leaf disease image data. Finally, an MFLoss function with a gradient penalty term is proposed to reduce the mode collapse during the training of generative adversarial networks. By comparing the visual indicators and evaluation indicators of the images generated by different models, and using the recognition network to verify the enhanced grape disease data, the results show that the method is effective in enhancing grape leaf disease data. Under the same experimental conditions, DMFGAN generates higher quality and more diverse images with fewer parameters than other generative adversarial networks. The mode breakdown times of generative adversarial networks in training process are reduced, which is more effective in practical application.
利用深度学习技术识别葡萄叶病害依赖于大量高质量的数据集。然而,大量的图像占用更多的计算资源,并且在训练过程中容易出现模式崩溃。在本文中,提出了一种深度可分离多特征生成对抗网络(DMFGAN)来增强葡萄叶病害数据。首先,设计了一种基于四通道特征融合策略的多特征提取块(MFEB),以提高生成图像的质量,并避免对抗生成网络因单通道特征提取方法而导致的特征学习能力差的问题。其次,设计了基于深度的 D 判别器,以提高判别器的能力并减少模型参数的数量。第三,用 SELU 激活函数替代 DCGAN 激活函数,以克服 DCGAN 激活函数不足以拟合葡萄叶病害图像数据的问题。最后,提出了一种带有梯度惩罚项的 MFLoss 函数,以减少生成对抗网络在训练过程中的模式崩溃。通过比较不同模型生成的图像的视觉指标和评价指标,并使用识别网络验证增强的葡萄病害数据,结果表明该方法在增强葡萄叶病害数据方面是有效的。在相同的实验条件下,DMFGAN 生成的图像质量更高、更具多样性,且参数更少。生成对抗网络在训练过程中的模式崩溃次数减少,在实际应用中更有效。