Dai Fen, Wang Fengcheng, Yang Dongzi, Lin Shaoming, Chen Xin, Lan Yubin, Deng Xiaoling
College of Electronic Engineering, College of Artificial Intelligence, South China Agricultural University, Guangzhou, China.
National Center for International Collaboration Research on Precision Agricultural Aviation Pesticide Spraying Technology, Guangzhou, China.
Front Plant Sci. 2022 Jan 24;12:816272. doi: 10.3389/fpls.2021.816272. eCollection 2021.
Citrus psyllid is the only insect vector of citrus Huanglongbing (HLB), which is the most destructive disease in the citrus industry. There is no effective treatment for HLB, so detecting citrus psyllids as soon as possible is the key prevention measure for citrus HLB. It is time-consuming and laborious to search for citrus psyllids through artificial patrol, which is inconvenient for the management of citrus orchards. With the development of artificial intelligence technology, a computer vision method instead of the artificial patrol can be adopted for orchard management to reduce the cost and time. The citrus psyllid is small in shape and gray in color, similar to the stem, stump, and withered part of the leaves, leading to difficulty for the traditional target detection algorithm to achieve a good recognition effect. In this work, in order to make the model have good generalization ability under outdoor light condition, a high-definition camera to collect data set of citrus psyllids and citrus fruit flies under natural light condition was used, a method to increase the number of small target pests in citrus based on semantic segmentation algorithm was proposed, and the cascade region-based convolution neural networks (R-CNN) (convolutional neural network) algorithm was improved to enhance the recognition effect of small target pests using multiscale training, combining CBAM attention mechanism with high-resolution feature retention network high-resoultion network (HRNet) as feature extraction network, adding sawtooth atrous spatial pyramid pooling (ASPP) structure to fully extract high-resolution features from different scales, and adding feature pyramid networks (FPN) structure for feature fusion at different scales. To mine difficult samples more deeply, an online hard sample mining strategy was adopted in the process of model sampling. The results show that the improved cascade R-CNN algorithm after training has an average recognition accuracy of 88.78% for citrus psyllids. Compared with VGG16, ResNet50, and other common networks, the improved small target recognition algorithm obtains the highest recognition performance. Experimental results also show that the improved cascade R-CNN algorithm not only performs well in citrus psylla identification but also in other small targets such as citrus fruit flies, which makes it possible and feasible to detect small target pests with a field high-definition camera.
柑橘木虱是柑橘黄龙病(HLB)唯一的昆虫传播媒介,而柑橘黄龙病是柑橘产业中最具毁灭性的病害。目前尚无针对柑橘黄龙病的有效治疗方法,因此尽早检测到柑橘木虱是预防柑橘黄龙病的关键措施。通过人工巡查来搜寻柑橘木虱既耗时又费力,不利于柑橘果园的管理。随着人工智能技术的发展,可以采用计算机视觉方法代替人工巡查进行果园管理,以降低成本和时间。柑橘木虱体型小且颜色为灰色,与茎、树桩和叶片的枯萎部分相似,导致传统目标检测算法难以取得良好的识别效果。在这项工作中,为了使模型在户外光照条件下具有良好的泛化能力,使用高清相机在自然光条件下收集柑橘木虱和柑橘果蝇的数据集,提出了一种基于语义分割算法增加柑橘中小目标害虫数量的方法,并对级联区域卷积神经网络(R-CNN)算法进行改进,通过多尺度训练增强小目标害虫的识别效果,将CBAM注意力机制与高分辨率特征保留网络高分辨率网络(HRNet)作为特征提取网络,添加锯齿空洞空间金字塔池化(ASPP)结构以充分提取不同尺度的高分辨率特征,并添加特征金字塔网络(FPN)结构进行不同尺度的特征融合。为了更深入地挖掘困难样本,在模型采样过程中采用了在线难样本挖掘策略。结果表明,训练后的改进级联R-CNN算法对柑橘木虱的平均识别准确率为88.78%。与VGG16、ResNet50等常见网络相比,改进后的小目标识别算法获得了最高的识别性能。实验结果还表明,改进后的级联R-CNN算法不仅在柑橘木虱识别方面表现良好,在柑橘果蝇等其他小目标识别上也表现出色,这使得利用田间高清相机检测小目标害虫成为可能且可行。