Li Jiajia, Chen Dong, Yin Xunyuan, Li Zhaojian
Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI, United States.
Environmental Institute, University of Virginia, Charlottesville, VA, United States.
Front Plant Sci. 2024 Aug 20;15:1396568. doi: 10.3389/fpls.2024.1396568. eCollection 2024.
Precision weed management (PWM), driven by machine vision and deep learning (DL) advancements, not only enhances agricultural product quality and optimizes crop yield but also provides a sustainable alternative to herbicide use. However, existing DL-based algorithms on weed detection are mainly developed based on supervised learning approaches, typically demanding large-scale datasets with manual-labeled annotations, which can be time-consuming and labor-intensive. As such, label-efficient learning methods, especially semi-supervised learning, have gained increased attention in the broader domain of computer vision and have demonstrated promising performance. These methods aim to utilize a small number of labeled data samples along with a great number of unlabeled samples to develop high-performing models comparable to the supervised learning counterpart trained on a large amount of labeled data samples. In this study, we assess the effectiveness of a semi-supervised learning framework for multi-class weed detection, employing two well-known object detection frameworks, namely FCOS (Fully Convolutional One-Stage Object Detection) and Faster-RCNN (Faster Region-based Convolutional Networks). Specifically, we evaluate a generalized student-teacher framework with an improved pseudo-label generation module to produce reliable pseudo-labels for the unlabeled data. To enhance generalization, an ensemble student network is employed to facilitate the training process. Experimental results show that the proposed approach is able to achieve approximately 76% and 96% detection accuracy as the supervised methods with only 10% of labeled data in CottonWeedDet3 and CottonWeedDet12, respectively. We offer access to the source code (https://github.com/JiajiaLi04/SemiWeeds), contributing a valuable resource for ongoing semi-supervised learning research in weed detection and beyond.
由机器视觉和深度学习(DL)进步驱动的精准杂草管理(PWM),不仅能提高农产品质量并优化作物产量,还为除草剂的使用提供了一种可持续的替代方案。然而,现有的基于深度学习的杂草检测算法主要是基于监督学习方法开发的,通常需要带有手动标注的大规模数据集,这可能既耗时又费力。因此,标签高效学习方法,尤其是半监督学习,在更广泛的计算机视觉领域受到了越来越多的关注,并已展现出有前景的性能。这些方法旨在利用少量的标注数据样本以及大量的未标注样本,来开发与在大量标注数据样本上训练的监督学习模型性能相当的高性能模型。在本研究中,我们评估了一个用于多类杂草检测的半监督学习框架的有效性,采用了两个著名的目标检测框架,即FCOS(全卷积单阶段目标检测)和Faster-RCNN(基于区域的更快卷积网络)。具体而言,我们评估了一个带有改进的伪标签生成模块的广义师生框架,以生成可靠的未标注数据伪标签。为了提高泛化能力,采用了一个集成学生网络来促进训练过程。实验结果表明,在CottonWeedDet3和CottonWeedDet12中,所提出的方法分别仅使用10%的标注数据时,就能达到与监督方法相近的检测准确率,分别约为76%和96%。我们提供了源代码访问(https://github.com/JiajiaLi04/SemiWeeds),为杂草检测及其他领域正在进行的半监督学习研究贡献了宝贵资源。