Zhang Bin, Wang Rongrong, Zhang Huiming, Yin Chenghai, Xia Yuyang, Fu Meng, Fu Wei
School of Information and Communication Engineering, Hainan University, Haikou, China.
Mechanical and Electrical Engineering College, Hainan University, Haikou, China.
Front Plant Sci. 2022 Oct 20;13:1040923. doi: 10.3389/fpls.2022.1040923. eCollection 2022.
An improved lightweight network (Improved YOLOv5s) was proposed based on YOLOv5s in this study to realise all-weather detection of dragon fruit in a complex orchard environment. A ghost module was introduced in the original YOLOv5s to realise the lightweight of the model. The coordinate attention mechanism was joined to make the model accurately locate and identify the dense dragon fruits. A bidirectional feature pyramid network was built to improve the detection effect of dragon fruit at different scales. SIoU loss function was adopted to improve the convergence speed during model training. The improved YOLOv5s model was used to detect a dragon fruit dataset collected in the natural environment. Results showed that the mean average precision (), precision () and recall () of the model was 97.4%, 96.4% and 95.2%, respectively. The model size, parameters (Params) and floating-point operations (FLOPs) were 11.5 MB, 5.2 M and 11.4 G, respectively. Compared with the original YOLOv5s network, the model size, Params and FLOPs of the improved model was reduced by 20.6%, 18.75% and 27.8%, respectively. Meanwhile, the of the improved model was improved by 1.1%. The results prove that the improved model had a more lightweight structure and better detection performance. Moreover, the average precision () of the improved YOLOv5s for dragon fruit under the front light, back light, side light, cloudy day and night was 99.5%, 97.3%, 98.5%, 95.5% and 96.1%, respectively. The detection performance met the requirements of all-weather detection of dragon fruit and the improved model had good robustness. This study provides a theoretical basis and technical support for fruit monitoring based on unmanned aerial vehicle technology and intelligent picking based on picking robot technology.
本研究基于YOLOv5s提出了一种改进的轻量级网络(改进的YOLOv5s),以实现复杂果园环境中火龙果的全天候检测。在原始的YOLOv5s中引入了幽灵模块以实现模型的轻量化。加入坐标注意力机制,使模型能够准确地定位和识别密集的火龙果。构建了双向特征金字塔网络以提高不同尺度下火龙果的检测效果。采用SIoU损失函数来提高模型训练期间的收敛速度。使用改进的YOLOv5s模型对在自然环境中收集的火龙果数据集进行检测。结果表明,该模型的平均精度(mAP)、精确率(P)和召回率(R)分别为97.4%、96.4%和95.2%。模型大小、参数(Params)和浮点运算量(FLOPs)分别为11.5 MB、5.2 M和11.4 G。与原始的YOLOv5s网络相比,改进模型的模型大小、Params和FLOPs分别减少了20.6%、18.75%和27.8%。同时,改进模型的mAP提高了1.1%。结果证明改进后的模型具有更轻量级的结构和更好的检测性能。此外,改进的YOLOv5s在强光、逆光、侧光、阴天和夜间条件下对火龙果的平均精度(mAP)分别为99.5%、97.3%、98.5%、95.5%和96.1%。检测性能满足火龙果全天候检测的要求,且改进模型具有良好的鲁棒性。本研究为基于无人机技术的果实监测和基于采摘机器人技术的智能采摘提供了理论依据和技术支持。