Zheng Caiwang, Abd-Elrahman Amr, Whitaker Vance M, Dalid Cheryl
Gulf Coast Research and Education Center, University of Florida, Wimauma, FL 33598, USA.
School of Forest, Fisheries, and Geomatics Sciences, University of Florida, Gainesville, FL 32603, USA.
Plant Phenomics. 2022 Oct 11;2022:9850486. doi: 10.34133/2022/9850486. eCollection 2022.
Modeling plant canopy biophysical parameters at the individual plant level remains a major challenge. This study presents a workflow for automatic strawberry canopy delineation and biomass prediction from high-resolution images using deep neural networks. High-resolution (5 mm) RGB orthoimages, near-infrared (NIR) orthoimages, and Digital Surface Models (DSM), which were generated by Structure from Motion (SfM), were utilized in this study. Mask R-CNN was applied to the orthoimages of two band combinations (RGB and RGB-NIR) to identify and delineate strawberry plant canopies. The average detection precision rate and recall rate were 97.28% and 99.71% for RGB images and 99.13% and 99.54% for RGB-NIR images, and the mean intersection over union () rates for instance segmentation were 98.32% and 98.45% for RGB and RGB-NIR images, respectively. Based on the center of the canopy mask, we imported the cropped RGB, NIR, DSM, and mask images of individual plants to vanilla deep regression models to model canopy leaf area and dry biomass. Two networks (VGG-16 and ResNet-50) were used as the backbone architecture for feature map extraction. The values of dry biomass models were about 0.76 and 0.79 for the VGG-16 and ResNet-50 networks, respectively. Similarly, the values of leaf area were 0.82 and 0.84, respectively. The RMSE values were approximately 8.31 and 8.73 g for dry biomass analyzed using the VGG-16 and ResNet-50 networks, respectively. Leaf area RMSE was 0.05 m for both networks. This work demonstrates the feasibility of deep learning networks in individual strawberry plant extraction and biomass estimation.
在单株植物水平上模拟植物冠层生物物理参数仍然是一项重大挑战。本研究提出了一种使用深度神经网络从高分辨率图像中自动进行草莓冠层 delineation 和生物量预测的工作流程。本研究使用了通过运动结构(SfM)生成的高分辨率(5毫米)RGB正射影像、近红外(NIR)正射影像和数字表面模型(DSM)。Mask R-CNN应用于两种波段组合(RGB和RGB-NIR)的正射影像,以识别和 delineate 草莓植株冠层。RGB图像的平均检测准确率和召回率分别为97.28%和99.71%,RGB-NIR图像的平均检测准确率和召回率分别为99.13%和99.54%,RGB和RGB-NIR图像实例分割的平均交并比()率分别为98.32%和98.45%。基于冠层掩码的中心,我们将单株植物的裁剪后的RGB、NIR、DSM和掩码图像导入到普通深度回归模型中,以模拟冠层叶面积和干生物量。两个网络(VGG-16和ResNet-50)用作特征图提取的骨干架构。VGG-16和ResNet-50网络的干生物量模型的值分别约为0.76和0.79。同样,叶面积的值分别为0.82和0.84。使用VGG-16和ResNet-50网络分析的干生物量的RMSE值分别约为8.31和8.73克。两个网络的叶面积RMSE均为0.05平方米。这项工作证明了深度学习网络在单株草莓提取和生物量估计中的可行性。