Shui Yuanqing, Yuan Kai, Wu Mengcheng, Zhao Zuoxi
College of Engineering, South China Agricultural University, Guangzhou 510642, China.
Key Laboratory of Key Technology on Agricultural Machine and Equipment, South China Agricultural University, Ministry of Education, Guangzhou 510642, China.
Plants (Basel). 2024 Oct 7;13(19):2808. doi: 10.3390/plants13192808.
Accurately detecting the maturity and 3D position of flowering Chinese cabbage ( var. chinensis) in natural environments is vital for autonomous robot harvesting in unstructured farms. The challenge lies in dense planting, small flower buds, similar colors and occlusions. This study proposes a YOLOv8-Improved network integrated with the ByteTrack tracking algorithm to achieve multi-object detection and 3D positioning of flowering Chinese cabbage plants in fields. In this study, C2F-MLCA is created by adding a lightweight Mixed Local Channel Attention (MLCA) with spatial awareness capability to the C2F module of YOLOv8, which improves the extraction of spatial feature information in the backbone network. In addition, a P2 detection layer is added to the neck network, and BiFPN is used instead of PAN to enhance multi-scale feature fusion and small target detection. Wise-IoU in combination with Inner-IoU is adopted as a new loss function to optimize the network for different quality samples and different size bounding boxes. Lastly, ByteTrack is integrated for video tracking, and RGB-D camera depth data are used to estimate cabbage positions. The experimental results show that YOLOv8-Improve achieves a precision () of 86.5% and a recall () of 86.0% in detecting the maturity of flowering Chinese cabbage. Among them, mAP50 and mAP75 reach 91.8% and 61.6%, respectively, representing an improvement of 2.9% and 4.7% over the original network. Additionally, the number of parameters is reduced by 25.43%. In summary, the improved YOLOv8 algorithm demonstrates high robustness and real-time detection performance, thereby providing strong technical support for automated harvesting management.
在自然环境中准确检测小白菜(变种:青菜)的成熟度和三维位置对于非结构化农场中的自主机器人收获至关重要。挑战在于种植密集、花芽小、颜色相似以及存在遮挡。本研究提出一种集成了ByteTrack跟踪算法的YOLOv8改进网络,以实现田间小白菜植株的多目标检测和三维定位。在本研究中,通过在YOLOv8的C2F模块中添加具有空间感知能力的轻量级混合局部通道注意力(MLCA)来创建C2F-MLCA,这提高了骨干网络中空间特征信息的提取。此外,在颈部网络中添加了一个P2检测层,并使用BiFPN代替PAN来增强多尺度特征融合和小目标检测。采用Wise-IoU与Inner-IoU相结合作为新的损失函数,针对不同质量样本和不同大小的边界框优化网络。最后,集成ByteTrack进行视频跟踪,并使用RGB-D相机深度数据估计白菜位置。实验结果表明,YOLOv8改进版在检测小白菜成熟度方面的精度(P)达到86.5%,召回率(R)达到86.0%。其中,mAP50和mAP75分别达到91.8%和61.6%,比原网络分别提高了2.9%和4.7%。此外,参数数量减少了25.43%。综上所述,改进后的YOLOv8算法具有很高的鲁棒性和实时检测性能,从而为自动化收获管理提供了有力的技术支持。