Li Jie, Wang Enguo, Qiao Jiangwei, Li Yi, Li Li, Yao Jian, Liao Guisheng
Hubei Key Laboratory for High-efficiency Utilization of Solar Energy and Operation Control of Energy Storage System, Hubei University of Technology, 430068, Wuhan, China.
Oil Crops Research Institute of the Chinese Academy of Agricultural Sciences, Key Laboratory of Biology and Genetic Improvement of Oil Crops, Chinese Academy of Agricultural Sciences, Wuhan, China.
Plant Methods. 2023 Apr 24;19(1):40. doi: 10.1186/s13007-023-01017-x.
The flowering period is a critical time for the growth of rape plants. Counting rape flower clusters can help farmers to predict the yield information of the corresponding rape fields. However, counting in-field is a time-consuming and labor-intensive task. To address this, we explored a deep learning counting method based on unmanned aircraft vehicle (UAV). The proposed method developed the in-field counting of rape flower clusters as a density estimation problem. It is different from the object detection method of counting the bounding boxes. The crucial step of the density map estimation using deep learning is to train a deep neural network that maps from an input image to the corresponding annotated density map.
We explored a rape flower cluster counting network series: RapeNet and RapeNet+. A rectangular box labeling-based rape flower clusters dataset (RFRB) and a centroid labeling-based rape flower clusters dataset (RFCP) were used for network model training. To verify the performance of RapeNet series, the paper compares the counting result with the real values of manual annotation. The average accuracy (Acc), relative root mean square error (rrMSE) and [Formula: see text] of the metrics are up to 0.9062, 12.03 and 0.9635 on the dataset RFRB, and 0.9538, 5.61 and 0.9826 on the dataset RFCP, respectively. The resolution has little influence for the proposed model. In addition, the visualization results have some interpretability.
Extensive experimental results demonstrate that the RapeNet series outperforms other state-of-the-art counting approaches. The proposed method provides an important technical support for the crop counting statistics of rape flower clusters in field.
花期是油菜生长的关键时期。统计油菜花丛数量有助于农民预测相应油菜田的产量信息。然而,实地统计是一项耗时且费力的任务。为解决这一问题,我们探索了一种基于无人机(UAV)的深度学习计数方法。所提出的方法将油菜花丛的实地计数发展为一个密度估计问题。它不同于通过计算边界框进行计数的目标检测方法。使用深度学习进行密度图估计的关键步骤是训练一个从输入图像映射到相应标注密度图的深度神经网络。
我们探索了一个油菜花丛计数网络系列:RapeNet和RapeNet+。基于矩形框标注的油菜花丛数据集(RFRB)和基于质心标注的油菜花丛数据集(RFCP)用于网络模型训练。为验证RapeNet系列的性能,本文将计数结果与人工标注的真实值进行比较。在数据集RFRB上,指标的平均准确率(Acc)(原文误写为rrMSE)、相对均方根误差(rrMSE)和[公式:见原文]分别高达0.9062、12.03和0.9635,在数据集RFCP上分别为0.9538、5.61和0.9826。分辨率对所提出的模型影响较小。此外,可视化结果具有一定的可解释性。
大量实验结果表明,RapeNet系列优于其他现有先进的计数方法。所提出的方法为田间油菜花丛的作物计数统计提供了重要的技术支持。