Li Yinglun, Zhan Xiaohai, Liu Shouyang, Lu Hao, Jiang Ruibo, Guo Wei, Chapman Scott, Ge Yufeng, Solan Benoit, Ding Yanfeng, Baret Frédéric
Plant Phenomics Research Centre, Academy for Advanced Interdisciplinary Studies, Jiangsu Collaborative Innovation Center for Modern Crop Production, Nanjing Agricultural University, Nanjing, China.
Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China.
Plant Phenomics. 2023 Apr 11;5:0041. doi: 10.34133/plantphenomics.0041. eCollection 2023.
The number of leaves at a given time is important to characterize plant growth and development. In this work, we developed a high-throughput method to count the number of leaves by detecting leaf tips in RGB images. The digital plant phenotyping platform was used to simulate a large and diverse dataset of RGB images and corresponding leaf tip labels of wheat plants at seedling stages (150,000 images with over 2 million labels). The realism of the images was then improved using domain adaptation methods before training deep learning models. The results demonstrate the efficiency of the proposed method evaluated on a diverse test dataset, collecting measurements from 5 countries obtained under different environments, growth stages, and lighting conditions with different cameras (450 images with over 2,162 labels). Among the 6 combinations of deep learning models and domain adaptation techniques, the Faster-RCNN model with cycle-consistent generative adversarial network adaptation technique provided the best performance ( = 0.94, root mean square error = 8.7). Complementary studies show that it is essential to simulate images with sufficient realism (background, leaf texture, and lighting conditions) before applying domain adaptation techniques. Furthermore, the spatial resolution should be better than 0.6 mm per pixel to identify leaf tips. The method is claimed to be self-supervised since no manual labeling is required for model training. The self-supervised phenotyping approach developed here offers great potential for addressing a wide range of plant phenotyping problems. The trained networks are available at https://github.com/YinglunLi/Wheat-leaf-tip-detection.
在特定时间的叶片数量对于描述植物的生长和发育至关重要。在这项工作中,我们开发了一种高通量方法,通过检测RGB图像中的叶尖来计算叶片数量。利用数字植物表型分析平台模拟了大量多样化的RGB图像数据集以及小麦幼苗期相应的叶尖标签(150,000张图像,超过200万个标签)。在训练深度学习模型之前,使用域适应方法提高了图像的真实感。结果证明了所提出方法在一个多样化测试数据集上的有效性,该数据集收集了来自5个国家在不同环境、生长阶段和光照条件下使用不同相机获取的数据(450张图像,超过2,162个标签)。在深度学习模型和域适应技术的6种组合中,采用循环一致生成对抗网络适应技术的Faster-RCNN模型表现最佳(准确率 = 0.94,均方根误差 = 8.7)。补充研究表明,在应用域适应技术之前,模拟具有足够真实感的图像(背景、叶片纹理和光照条件)至关重要。此外,空间分辨率应优于每像素0.6毫米才能识别叶尖。该方法据称是自监督的,因为模型训练无需人工标注。这里开发的自监督表型分析方法在解决广泛的植物表型问题方面具有巨大潜力。训练好的网络可在https://github.com/YinglunLi/Wheat-leaf-tip-detection获取。
Front Plant Sci. 2020-2-28
Plants (Basel). 2021-11-30
Plant Methods. 2018-1-18
Front Plant Sci. 2020-12-7
Front Plant Sci. 2025-7-22
Front Plant Sci. 2025-5-8
Sensors (Basel). 2024-8-15
Plant Phenomics. 2024-2-12
Plant Phenomics. 2023-11-28
Plants (Basel). 2021-11-30
Plant Phenomics. 2021-9-22
Front Plant Sci. 2020-12-7
Plant Phenomics. 2019-1-22
Funct Plant Biol. 2008-12
Funct Plant Biol. 2016-2
Plant Methods. 2020-3-7