College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao, 266590, Shandong, China.
School of Mechanics and Automation, Weifang University, Weifang, 261061, Shandong, China.
Sci Rep. 2023 Mar 20;13(1):4587. doi: 10.1038/s41598-023-31608-6.
The efficient detection of grapes is a crucial technology for fruit-picking robots. To better identify grapes from branch shading that is similar to the fruit color and improve the detection accuracy of green grapes due to cluster adhesion, this study proposes a Shine-Muscat Grape Detection Model (S-MGDM) based on improved YOLOv3 for the ripening stage. DenseNet is fused in the backbone feature extraction network to extract richer underlying grape information; depth-separable convolution, CBAM, and SPPNet are added in the multi-scale detection module to increase the perceptual field of grape targets and reduce the model computation; meanwhile, PANet is combined with FPN to promote inter-network information flow and iteratively extract grape features. In addition, the CIOU regression loss function is used and the prior frame size is modified by the k-means algorithm to improve the accuracy of detection. The improved detection model achieves an AP value of 96.73% and an F1 value of 91% on the test set, which are 3.87% and 3% higher than the original network model, respectively; the average detection speed under GPU reaches 26.95 frames/s, which is 6.49 frames/s higher than the original model. The comparison results with several mainstream detection algorithms such as SSD and YOLO series show that the method has excellent detection accuracy and good real-time performance, which is an important reference value for the problem of accurate identification of Shine-Muscat grapes at maturity.
葡萄的高效检测是采摘机器人的关键技术。为了更好地识别与果实颜色相似的枝蔓阴影中的葡萄,并提高因串粘连而导致的绿葡萄的检测精度,本研究提出了一种基于改进 YOLOv3 的 Shine-Muscat 葡萄检测模型(S-MGDM),用于成熟阶段。在骨干特征提取网络中融合了 DenseNet,以提取更丰富的葡萄底层信息;在多尺度检测模块中添加了深度可分离卷积、CBAM 和 SPPNet,以增加葡萄目标的感知域并减少模型计算量;同时,结合 PANet 和 FPN 以促进网络间信息流动并迭代提取葡萄特征。此外,使用了 CIOU 回归损失函数,并通过 k-means 算法修改了先验帧大小,以提高检测精度。改进后的检测模型在测试集上的 AP 值和 F1 值分别达到 96.73%和 91%,分别比原始网络模型提高了 3.87%和 3%;在 GPU 下的平均检测速度达到 26.95 帧/秒,比原始模型提高了 6.49 帧/秒。与 SSD 和 YOLO 系列等几种主流检测算法的比较结果表明,该方法具有出色的检测精度和良好的实时性能,这对 Shine-Muscat 葡萄成熟时的准确识别问题具有重要的参考价值。