Zhu Jiajun, Cheng Man, Wang Qifan, Yuan Hongbo, Cai Zhenjiang
College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China.
Front Plant Sci. 2021 Jun 29;12:695749. doi: 10.3389/fpls.2021.695749. eCollection 2021.
The disease spots on the grape leaves can be detected by using the image processing and deep learning methods. However, the accuracy and efficiency of the detection are still the challenges. The convolutional substrate information is fuzzy, and the detection results are not satisfactory if the disease spot is relatively small. In particular, the detection will be difficult if the number of pixels of the spot is <32 × 32 in the image. In order to effectively address this problem, we present a super-resolution image enhancement and convolutional neural network-based algorithm for the detection of black rot on grape leaves. First, the original image is up-sampled and enhanced with local details using the bilinear interpolation. As a result, the number of pixels in the image increase. Then, the enhanced images are fed into the proposed YOLOv3-SPP network for detection. In the proposed network, the IOU (Intersection Over Union, IOU) in the original YOLOv3 network is replaced with GIOU (Generalized Intersection Over Union, GIOU). In addition, we also add the SPP (Spatial Pyramid Pooling, SPP) module to improve the detection performance of the network. Finally, the official pre-trained weights of YOLOv3 are used for fast convergence. The test set test_pv from the Plant Village and the test set test_orchard from the orchard field were used to evaluate the network performance. The results of test_pv show that the grape leaf black rot is detected by the YOLOv3-SPP with 95.79% detection accuracy and 94.52% detector recall, which is a 5.94% greater in terms of accuracy and 10.67% greater in terms of recall as compared to the original YOLOv3. The results of test_orchard show that the method proposed in this paper can be applied in field environment with 86.69% detection precision and 82.27% detector recall, and the accuracy and recall were improved to 94.05 and 93.26% if the images with the simple background. Therefore, the detection method proposed in this work effectively solves the detection task of small targets and improves the detection effectiveness of the grape leaf black rot.
利用图像处理和深度学习方法可以检测葡萄叶片上的病斑。然而,检测的准确性和效率仍然是挑战。卷积底物信息模糊,如果病斑相对较小,检测结果并不理想。特别是,如果图像中病斑的像素数<32×32,检测将很困难。为了有效解决这个问题,我们提出了一种基于超分辨率图像增强和卷积神经网络的葡萄叶片黑腐病检测算法。首先,使用双线性插值对原始图像进行上采样并增强局部细节。结果,图像中的像素数量增加。然后,将增强后的图像输入到提出的YOLOv3-SPP网络进行检测。在所提出的网络中,原始YOLOv3网络中的IOU(交并比,IOU)被GIOU(广义交并比,GIOU)取代。此外,我们还添加了SPP(空间金字塔池化,SPP)模块来提高网络的检测性能。最后,使用YOLOv3的官方预训练权重进行快速收敛。使用来自植物村的测试集test_pv和果园的测试集test_orchard来评估网络性能。test_pv的结果表明,YOLOv3-SPP检测葡萄叶片黑腐病的准确率为95.79%,检测器召回率为94.52%,与原始YOLOv3相比,准确率提高了5.94%,召回率提高了10.67%。test_orchard的结果表明,本文提出的方法可以应用于田间环境,检测精度为86.69%,检测器召回率为82.27%,如果是简单背景的图像,准确率和召回率分别提高到94.05和93.26%。因此,本文提出的检测方法有效地解决了小目标的检测任务,提高了葡萄叶片黑腐病的检测效果。