Xue Wei, Ding Haifeng, Jin Tao, Meng Jialing, Wang Shiyou, Liu Zuo, Ma Xiupeng, Li Ji
College of Artificial Intelligence, Nanjing Agricultural University, Nanjing 210095, China.
State Key Laboratory of Crop Genetics and Germplasm Enhancement, College of Horticulture, Nanjing Agricultural University, No. 1 Weigang, Nanjing 210095, China.
Plant Phenomics. 2024 Jun 27;6:0193. doi: 10.34133/plantphenomics.0193. eCollection 2024.
Cucumber is an important vegetable crop that has high nutritional and economic value and is thus favored by consumers worldwide. Exploring an accurate and fast technique for measuring the morphological traits of cucumber fruit could be helpful for improving its breeding efficiency and further refining the development models for pepo fruits. At present, several sets of measurement schemes and standards have been proposed and applied for the characterization of cucumber fruits; however, these manual methods are time-consuming and inefficient. Therefore, in this paper, we propose a cucumber fruit morphological trait identification framework and software called CucumberAI, which combines image processing techniques with deep learning models to efficiently identify up to 51 cucumber features, including 32 newly defined parameters. The proposed tool introduces an algorithm for performing cucumber contour extraction and fruit segmentation based on image processing techniques. The identification framework comprises 6 deep learning models that combine fruit feature recognition rules with MobileNetV2 to construct a decision tree for fruit shape recognition. Additionally, the framework employs U-Net segmentation models for fruit stripe and endocarp segmentation, a MobileNetV2 model for carpel classification, a ResNet50 model for stripe classification and a YOLOv5 model for tumor identification. The relationships between the image-based manual and algorithmic traits are highly correlated, and validation tests were conducted to perform correlation analyses of fruit surface smoothness and roughness, and a fruit appearance cluster analysis was also performed. In brief, CucumberAI offers an efficient approach for extracting and analyzing cucumber phenotypes and provides valuable information for future cucumber genetic improvements.
黄瓜是一种重要的蔬菜作物,具有很高的营养和经济价值,因此受到全球消费者的青睐。探索一种准确、快速的黄瓜果实形态特征测量技术,有助于提高其育种效率,并进一步完善瓠果类果实的发育模型。目前,已经提出并应用了几套测量方案和标准来描述黄瓜果实;然而,这些人工方法耗时且效率低下。因此,在本文中,我们提出了一个黄瓜果实形态特征识别框架和名为CucumberAI的软件,它将图像处理技术与深度学习模型相结合,能够高效识别多达51个黄瓜特征,包括32个新定义的参数。所提出的工具引入了一种基于图像处理技术进行黄瓜轮廓提取和果实分割的算法。该识别框架由6个深度学习模型组成,这些模型将果实特征识别规则与MobileNetV2相结合,构建了一个用于果实形状识别的决策树。此外,该框架采用U-Net分割模型进行果纹和内果皮分割,采用MobileNetV2模型进行心皮分类,采用ResNet50模型进行条纹分类,采用YOLOv5模型进行瘤状物识别。基于图像的人工特征与算法特征之间的关系高度相关,并进行了验证测试以对果实表面的光滑度和粗糙度进行相关性分析,还进行了果实外观聚类分析。简而言之,CucumberAI为提取和分析黄瓜表型提供了一种有效的方法,并为未来黄瓜的遗传改良提供了有价值的信息。