Suppr超能文献

利用深度学习分割技术在无人机RGB图像中进行植物检测以及模型精度对下游分析的影响

Plant Detection in RGB Images from Unmanned Aerial Vehicles Using Segmentation by Deep Learning and an Impact of Model Accuracy on Downstream Analysis.

作者信息

Kozhekin Mikhail V, Genaev Mikhail A, Komyshev Evgenii G, Zavyalov Zakhar A, Afonnikov Dmitry A

机构信息

Institute of Cytology and Genetics, Siberian Branch of Russian Academy of Sciences, 630090 Novosibirsk, Russia.

Kurchatov Center for Genome Research, Institute of Cytology and Genetics, Siberian Branch of Russian Academy of Sciences, 630090 Novosibirsk, Russia.

出版信息

J Imaging. 2025 Jan 20;11(1):28. doi: 10.3390/jimaging11010028.

Abstract

Crop field monitoring using unmanned aerial vehicles (UAVs) is one of the most important technologies for plant growth control in modern precision agriculture. One of the important and widely used tasks in field monitoring is plant stand counting. The accurate identification of plants in field images provides estimates of plant number per unit area, detects missing seedlings, and predicts crop yield. Current methods are based on the detection of plants in images obtained from UAVs by means of computer vision algorithms and deep learning neural networks. These approaches depend on image spatial resolution and the quality of plant markup. The performance of automatic plant detection may affect the efficiency of downstream analysis of a field cropping pattern. In the present work, a method is presented for detecting the plants of five species in images acquired via a UAV on the basis of image segmentation by deep learning algorithms (convolutional neural networks). Twelve orthomosaics were collected and marked at several sites in Russia to train and test the neural network algorithms. Additionally, 17 existing datasets of various spatial resolutions and markup quality levels from the Roboflow service were used to extend training image sets. Finally, we compared several texture features between manually evaluated and neural-network-estimated plant masks. It was demonstrated that adding images to the training sample (even those of lower resolution and markup quality) improves plant stand counting significantly. The work indicates how the accuracy of plant detection in field images may affect their cropping pattern evaluation by means of texture characteristics. For some of the characteristics (GLCM mean, GLRM long run, GLRM run ratio) the estimates between images marked manually and automatically are close. For others, the differences are large and may lead to erroneous conclusions about the properties of field cropping patterns. Nonetheless, overall, plant detection algorithms with a higher accuracy show better agreement with the estimates of texture parameters obtained from manually marked images.

摘要

使用无人机(UAV)进行农田监测是现代精准农业中植物生长控制的最重要技术之一。田间监测中一项重要且广泛应用的任务是植株计数。准确识别田间图像中的植物可提供单位面积内植物数量的估计值,检测出缺苗情况,并预测作物产量。当前的方法是基于通过计算机视觉算法和深度学习神经网络从无人机获取的图像中检测植物。这些方法依赖于图像空间分辨率和植物标记的质量。自动植物检测的性能可能会影响田间种植模式下游分析的效率。在本研究中,提出了一种基于深度学习算法(卷积神经网络)的图像分割方法,用于检测通过无人机获取的图像中的五种植物。在俄罗斯的几个地点收集了12幅正射镶嵌影像并进行了标记,以训练和测试神经网络算法。此外,还使用了来自Roboflow服务的17个具有不同空间分辨率和标记质量水平的现有数据集来扩展训练图像集。最后,我们比较了人工评估和神经网络估计的植物掩膜之间的几种纹理特征。结果表明,向训练样本中添加图像(即使是分辨率和标记质量较低的图像)可显著提高植株计数的准确性。这项工作表明了田间图像中植物检测的准确性如何通过纹理特征影响其种植模式评估。对于某些特征(灰度共生矩阵均值、灰度行程长度矩阵长行程、灰度行程长度矩阵行程比),人工标记和自动标记图像之间的估计值接近。对于其他特征,差异较大,可能会导致关于田间种植模式属性的错误结论。尽管如此,总体而言,具有较高准确性的植物检测算法与从人工标记图像中获得的纹理参数估计值显示出更好的一致性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/99d0/11766541/4434c7d237d4/jimaging-11-00028-g001.jpg

相似文献

2
Sorghum Panicle Detection and Counting Using Unmanned Aerial System Images and Deep Learning.
Front Plant Sci. 2020 Sep 2;11:534853. doi: 10.3389/fpls.2020.534853. eCollection 2020.
3
Brain tumor segmentation and detection in MRI using convolutional neural networks and VGG16.
Cancer Biomark. 2025 Mar;42(3):18758592241311184. doi: 10.1177/18758592241311184. Epub 2025 Apr 4.
4
A survey on deep learning-based identification of plant and crop diseases from UAV-based aerial images.
Cluster Comput. 2023;26(2):1297-1317. doi: 10.1007/s10586-022-03627-x. Epub 2022 Aug 3.
6
Using computer vision, image analysis and UAVs for the automatic recognition and counting of common cranes (Grus grus).
J Environ Manage. 2023 Feb 15;328:116948. doi: 10.1016/j.jenvman.2022.116948. Epub 2022 Dec 12.

本文引用的文献

1
Image-based classification of wheat spikes by glume pubescence using convolutional neural networks.
Front Plant Sci. 2024 Jan 12;14:1336192. doi: 10.3389/fpls.2023.1336192. eCollection 2023.
2
Rice Plant Counting, Locating, and Sizing Method Based on High-Throughput UAV RGB Images.
Plant Phenomics. 2023;5:0020. doi: 10.34133/plantphenomics.0020. Epub 2023 Jan 30.
4
Application of UAV Multisensor Data and Ensemble Approach for High-Throughput Estimation of Maize Phenotyping Traits.
Plant Phenomics. 2022 Aug 27;2022:9802585. doi: 10.34133/2022/9802585. eCollection 2022.
5
Yield estimation of high-density cotton fields using low-altitude UAV imaging and deep learning.
Plant Methods. 2022 Apr 27;18(1):55. doi: 10.1186/s13007-022-00881-3.
7
Estimating leaf area index using unmanned aerial vehicle data: shallow vs. deep machine learning algorithms.
Plant Physiol. 2021 Nov 3;187(3):1551-1576. doi: 10.1093/plphys/kiab322.
8
UAS-Based Plant Phenotyping for Research and Breeding Applications.
Plant Phenomics. 2021 Jun 10;2021:9840192. doi: 10.34133/2021/9840192. eCollection 2021.
9
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions.
J Big Data. 2021;8(1):53. doi: 10.1186/s40537-021-00444-8. Epub 2021 Mar 31.
10
High Throughput Field Phenotyping for Plant Height Using UAV-Based RGB Imagery in Wheat Breeding Lines: Feasibility and Validation.
Front Plant Sci. 2021 Feb 16;12:591587. doi: 10.3389/fpls.2021.591587. eCollection 2021.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验