School of Computer Science, University of Nottingham, Jubilee Campus, Wollaton Road, Nottingham NG8 1BB, UK.
School of Biosciences, Sutton Bonington Campus, University of Nottingham, Nottingham LE12 5RD, UK.
Gigascience. 2019 Nov 1;8(11). doi: 10.1093/gigascience/giz123.
BACKGROUND: In recent years quantitative analysis of root growth has become increasingly important as a way to explore the influence of abiotic stress such as high temperature and drought on a plant's ability to take up water and nutrients. Segmentation and feature extraction of plant roots from images presents a significant computer vision challenge. Root images contain complicated structures, variations in size, background, occlusion, clutter and variation in lighting conditions. We present a new image analysis approach that provides fully automatic extraction of complex root system architectures from a range of plant species in varied imaging set-ups. Driven by modern deep-learning approaches, RootNav 2.0 replaces previously manual and semi-automatic feature extraction with an extremely deep multi-task convolutional neural network architecture. The network also locates seeds, first order and second order root tips to drive a search algorithm seeking optimal paths throughout the image, extracting accurate architectures without user interaction. RESULTS: We develop and train a novel deep network architecture to explicitly combine local pixel information with global scene information in order to accurately segment small root features across high-resolution images. The proposed method was evaluated on images of wheat (Triticum aestivum L.) from a seedling assay. Compared with semi-automatic analysis via the original RootNav tool, the proposed method demonstrated comparable accuracy, with a 10-fold increase in speed. The network was able to adapt to different plant species via transfer learning, offering similar accuracy when transferred to an Arabidopsis thaliana plate assay. A final instance of transfer learning, to images of Brassica napus from a hydroponic assay, still demonstrated good accuracy despite many fewer training images. CONCLUSIONS: We present RootNav 2.0, a new approach to root image analysis driven by a deep neural network. The tool can be adapted to new image domains with a reduced number of images, and offers substantial speed improvements over semi-automatic and manual approaches. The tool outputs root architectures in the widely accepted RSML standard, for which numerous analysis packages exist (http://rootsystemml.github.io/), as well as segmentation masks compatible with other automated measurement tools. The tool will provide researchers with the ability to analyse root systems at larget scales than ever before, at a time when large scale genomic studies have made this more important than ever.
背景:近年来,定量分析根系生长变得越来越重要,它可以作为一种方法来探索非生物胁迫(如高温和干旱)对植物吸收水分和养分能力的影响。从图像中对植物根系进行分割和特征提取是计算机视觉面临的一个重大挑战。根系图像包含复杂的结构、大小变化、背景、遮挡、杂乱和光照条件变化。我们提出了一种新的图像分析方法,该方法可以从各种成像设置的不同植物物种中全自动提取复杂的根系系统结构。受现代深度学习方法的驱动,RootNav 2.0 用一个极其深的多任务卷积神经网络架构取代了以前的手动和半自动特征提取。该网络还定位种子、一级和二级根尖,驱动搜索算法在整个图像中寻找最佳路径,无需用户交互即可提取准确的结构。
结果:我们开发并训练了一个新的深度网络架构,该架构明确地将局部像素信息与全局场景信息结合起来,以便在高分辨率图像中准确地分割小的根系特征。该方法在从小麦(Triticum aestivum L.)幼苗试验获得的图像上进行了评估。与原始 RootNav 工具的半自动分析相比,该方法的准确性相当,速度提高了 10 倍。通过迁移学习,该网络可以适应不同的植物物种,当转移到拟南芥平板试验时,仍然具有相似的准确性。最后一次通过迁移学习,将其应用于水培试验中的油菜(Brassica napus)图像,尽管训练图像较少,但仍然具有良好的准确性。
结论:我们提出了由深度神经网络驱动的新的根系图像分析方法 RootNav 2.0。该工具可以用较少的图像适应新的图像领域,并提供比半自动和手动方法有显著的速度提高。该工具以广泛接受的 RSML 标准输出根系结构,该标准有许多分析包(http://rootsystemml.github.io/),以及与其他自动测量工具兼容的分割掩模。该工具将为研究人员提供在大规模基因组研究比以往任何时候都更重要的时代以前所未有的规模分析根系系统的能力。
Gigascience. 2019-11-1
Plant Physiol. 2013-6-13
IEEE Trans Image Process. 2020-5-12
Sensors (Basel). 2017-9-4
IEEE Trans Image Process. 2021
Comput Methods Programs Biomed. 2020-2
Comput Methods Programs Biomed. 2020-7
Comput Med Imaging Graph. 2021-6
AoB Plants. 2024-9-19
Plant Phenomics. 2024-4-18
Plant Phenomics. 2024-4-12
Plant Phenomics. 2024-1-16
Front Artif Intell. 2023-9-19
Hortic Res. 2023-6-14
Quant Plant Biol. 2022-5-24
Plant Phenomics. 2019-3-26
Funct Plant Biol. 2008-12
Curr Opin Biotechnol. 2018-7-19
Front Plant Sci. 2017-7-7
IEEE Trans Pattern Anal Mach Intell. 2017-1-2
Front Plant Sci. 2016-9-22
IEEE Trans Pattern Anal Mach Intell. 2016-5-24
Trends Plant Sci. 2015-12-1