Shen Xiaojun, Shao Chaofan, Cheng Danyi, Yao Lili, Zhou Cheng
School of Information Engineering, Huzhou University, Huzhou, China.
Zhejiang Province Key Laboratory of Smart Management & Application of Modern Agricultural Resources, School of Information Engineering, Huzhou University, Huzhou, Zhejiang, China.
Front Plant Sci. 2024 Sep 23;15:1455687. doi: 10.3389/fpls.2024.1455687. eCollection 2024.
Accurate and rapid identification of cabbage posture is crucial for minimizing damage to cabbage heads during mechanical harvesting. However, due to the structural complexity of cabbages, current methods encounter challenges in detecting and segmenting the heads and roots. Therefore, exploring efficient cabbage posture prediction methods is of great significance.
This study introduces YOLOv5-POS, an innovative cabbage posture prediction approach. Building on the YOLOv5s backbone, this method enhances detection and segmentation capabilities for cabbage heads and roots by incorporating C-RepGFPN to replace the traditional Neck layer, optimizing feature extraction and upsampling strategies, and refining the C-Seg segmentation head. Additionally, a cabbage root growth prediction model based on Bézier curves is proposed, using the geometric moment method for key point identification and the anti-gravity stem-seeking principle to determine root-head junctions. It performs precision root growth curve fitting and prediction, effectively overcoming the challenge posed by the outer leaves completely enclosing the cabbage root stem.
YOLOv5-POS was tested on a multi-variety cabbage dataset, achieving an F1 score of 98.8% for head and root detection, with an instance segmentation accuracy of 93.5%. The posture recognition model demonstrated an average absolute error of 1.38° and an average relative error of 2.32%, while the root growth prediction model reached an accuracy of 98%. Cabbage posture recognition was completed within 28 milliseconds, enabling real-time harvesting. The enhanced model effectively addresses the challenges of cabbage segmentation and posture prediction, providing a highly accurate and efficient solution for automated harvesting, minimizing crop damage, and improving operational efficiency.
准确快速地识别甘蓝姿态对于在机械收获过程中尽量减少对甘蓝头部的损伤至关重要。然而,由于甘蓝结构复杂,当前方法在检测和分割甘蓝头部及根部时面临挑战。因此,探索高效的甘蓝姿态预测方法具有重要意义。
本研究引入了YOLOv5-POS,一种创新的甘蓝姿态预测方法。该方法基于YOLOv5s主干,通过合并C-RepGFPN以取代传统的颈部层、优化特征提取和上采样策略以及改进C-Seg分割头,增强了对甘蓝头部和根部的检测与分割能力。此外,还提出了一种基于贝塞尔曲线的甘蓝根生长预测模型,利用几何矩法进行关键点识别,并根据反重力茎寻找原理确定根-头连接点。它进行精确的根生长曲线拟合和预测,有效克服了外层叶片完全包裹甘蓝根茎所带来的挑战。
YOLOv5-POS在多品种甘蓝数据集上进行了测试,头部和根部检测的F1分数达到98.8%,实例分割准确率为93.5%。姿态识别模型的平均绝对误差为1.38°,平均相对误差为2.32%,而根生长预测模型的准确率达到98%。甘蓝姿态识别在28毫秒内完成,实现了实时收获。增强后的模型有效解决了甘蓝分割和姿态预测的挑战,为自动收获提供了高度准确和高效的解决方案,最大限度地减少了作物损伤并提高了作业效率。