Yang Sen, Zhou Gang, Feng Yuwei, Zhang Jiang, Jia Zhenhong
School of Computer Science and Technology, Xinjiang University, Urumqi, China.
The Key Laboratory of Signal Detection and Processing, Xinjiang Uygur Autonomous Region, Xinjiang University, Urumqi, China.
Front Plant Sci. 2024 Aug 9;15:1416940. doi: 10.3389/fpls.2024.1416940. eCollection 2024.
Effective pest management is important during the natural growth phases of cotton in the wild. As cotton fields are infested with "tiny pests" (smaller than 32×32 pixels) and "very tiny pests" (smaller than 16×16 pixels) during growth, making it difficult for common object detection models to accurately detect and fail to make sound agricultural decisions.
In this study, we proposed a framework for detecting "tiny pests" and "very tiny pests" in wild cotton fields, named SRNet-YOLO. SRNet-YOLO includes a YOLOv8 feature extraction module, a feature map super-resolution reconstruction module (FM-SR), and a fusion mechanism based on BiFormer attention (BiFormerAF). Specially, the FM-SR module is designed for the feature map level to recover the important feature in detail, in other words, this module reconstructs the P5 layer feature map into the size of the P3 layer. And then we designed the BiFormerAF module to fuse this reconstruct layer with the P3 layer, which greatly improves the detection performance. The purpose of the BiFormerAF module is to solve the problem of possible loss of feature after reconstruction. Additionally, to validate the performance of our method for "tiny pests" and "very tiny pests" detection in cotton fields, we have developed a large dataset, named Cotton-Yellow-Sticky-2023, which collected pests by yellow sticky traps.
Through comprehensive experimental verification, we demonstrate that our proposed framework achieves exceptional performance. Our method achieved 78.2% mAP on the "tiny pests" test result, it surpasses the performance of leading detection models such as YOLOv3, YOLOv5, YOLOv7 and YOLOv8 by 6.9%, 7.2%, 5.7% and 4.1%, respectively. Meanwhile, our results on "very tiny pests" reached 57% mAP, which are 32.2% higher than YOLOv8. To verify the generalizability of the model, our experiments on Yellow Sticky Traps (low-resolution) dataset still maintained the highest 92.8% mAP.
The above experimental results indicate that our model not only provides help in solving the problem of tiny pests in cotton fields, but also has good generalizability and can be used for the detection of tiny pests in other crops.
在野生棉花自然生长阶段,有效的害虫管理至关重要。由于棉田在生长期间会受到“微小害虫”(小于32×32像素)和“非常微小害虫”(小于16×16像素)的侵害,这使得常见目标检测模型难以准确检测,进而无法做出合理的农业决策。
在本研究中,我们提出了一种用于检测野生棉田“微小害虫”和“非常微小害虫”的框架,名为SRNet - YOLO。SRNet - YOLO包括一个YOLOv8特征提取模块、一个特征图超分辨率重建模块(FM - SR)以及基于BiFormer注意力的融合机制(BiFormerAF)。具体而言,FM - SR模块是针对特征图层面设计的,用于详细恢复重要特征,也就是说,该模块将P5层特征图重建为P3层大小。然后我们设计了BiFormerAF模块,将这个重建层与P3层进行融合,这大大提高了检测性能。BiFormerAF模块的目的是解决重建后可能出现的特征丢失问题。此外,为了验证我们的方法在棉田“微小害虫”和“非常微小害虫”检测方面的性能,我们开发了一个名为Cotton - Yellow - Sticky - 2023的大型数据集,该数据集通过黄色粘虫板收集害虫。
通过全面的实验验证,我们证明了所提出的框架具有卓越的性能。我们的方法在“微小害虫”测试结果上达到了78.2%的平均精度均值(mAP),分别比YOLOv3、YOLOv5、YOLOv7和YOLOv8等领先检测模型的性能高出6.9%、7.2%、5.7%和4.1%。同时,我们在“非常微小害虫”上的结果达到了57%的mAP,比YOLOv8高出32.2%。为了验证模型的通用性,我们在黄色粘虫板(低分辨率)数据集上的实验仍保持最高92.8%的mAP。
上述实验结果表明,我们的模型不仅有助于解决棉田微小害虫问题,而且具有良好的通用性,可用于其他作物微小害虫的检测。