School of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing 210037, China.
Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing Forestry University, Nanjing 210037, China.
Sensors (Basel). 2023 Apr 7;23(8):3803. doi: 10.3390/s23083803.
Dragon fruit is one of the most popular fruits in China and Southeast Asia. It, however, is mainly picked manually, imposing high labor intensity on farmers. The hard branches and complex postures of dragon fruit make it difficult to achieve automated picking. For picking dragon fruits with diverse postures, this paper proposes a new dragon fruit detection method, not only to identify and locate the dragon fruit, but also to detect the endpoints that are at the head and root of the dragon fruit, which can provide more visual information for the dragon fruit picking robot. First, YOLOv7 is used to locate and classify the dragon fruit. Then, we propose a PSP-Ellipse method to further detect the endpoints of the dragon fruit, including dragon fruit segmentation via PSPNet, endpoints positioning via an ellipse fitting algorithm and endpoints classification via ResNet. To test the proposed method, some experiments are conducted. In dragon fruit detection, the precision, recall and average precision of YOLOv7 are 0.844, 0.924 and 0.932, respectively. YOLOv7 also performs better compared with some other models. In dragon fruit segmentation, the segmentation performance of PSPNet on dragon fruit is better than some other commonly used semantic segmentation models, with the segmentation precision, recall and mean intersection over union being 0.959, 0.943 and 0.906, respectively. In endpoints detection, the distance error and angle error of endpoints positioning based on ellipse fitting are 39.8 pixels and 4.3°, and the classification accuracy of endpoints based on ResNet is 0.92. The proposed PSP-Ellipse method makes a great improvement compared with two kinds of keypoint regression method based on ResNet and UNet. Orchard picking experiments verified that the method proposed in this paper is effective. The detection method proposed in this paper not only promotes the progress of the automatic picking of dragon fruit, but it also provides a reference for other fruit detection.
火龙果是中国和东南亚最受欢迎的水果之一。然而,火龙果主要是人工采摘,这给农民带来了很高的劳动强度。火龙果坚硬的树枝和复杂的姿态使得自动化采摘变得困难。针对姿态各异的火龙果采摘问题,本文提出了一种新的火龙果检测方法,不仅可以识别和定位火龙果,还可以检测火龙果的头部和根部端点,为火龙果采摘机器人提供更多的视觉信息。首先,使用 YOLOv7 对火龙果进行定位和分类。然后,我们提出了一种 PSP-Ellipse 方法来进一步检测火龙果的端点,包括通过 PSPNet 对火龙果进行分割、通过椭圆拟合算法对端点进行定位以及通过 ResNet 对端点进行分类。为了测试所提出的方法,进行了一些实验。在火龙果检测方面,YOLOv7 的精度、召回率和平均精度分别为 0.844、0.924 和 0.932,并且比其他一些模型表现更好。在火龙果分割方面,PSPNet 在火龙果上的分割性能优于一些常用的语义分割模型,分割精度、召回率和平均交并比分别为 0.959、0.943 和 0.906。在端点检测方面,基于椭圆拟合的端点定位的距离误差和角度误差分别为 39.8 像素和 4.3°,基于 ResNet 的端点分类准确率为 0.92。与基于 ResNet 和 UNet 的两种关键点回归方法相比,所提出的 PSP-Ellipse 方法有了很大的改进。果园采摘实验验证了本文所提出方法的有效性。本文提出的检测方法不仅促进了火龙果自动采摘的进展,而且为其他水果的检测提供了参考。
Sensors (Basel). 2023-4-7
Front Plant Sci. 2023-9-28
Plants (Basel). 2023-8-7
Sensors (Basel). 2023-5-26
Front Plant Sci. 2023-1-4
Sensors (Basel). 2023-10-13
Plants (Basel). 2022-11-27
Front Plant Sci. 2023-8-17
PLoS One. 2025-9-5
Sensors (Basel). 2024-8-28
Animals (Basel). 2024-8-21
Sensors (Basel). 2023-2-6
Sensors (Basel). 2022-7-11
Sensors (Basel). 2020-11-27
Front Plant Sci. 2020-5-19
Sensors (Basel). 2019-6-18