Department of Computer Science and Engineering, Grace College of Engineering, Mullakkadu, Thoothukoodi, India.
School of Built Environment, Engineering and Computing, Leeds Beckett University, LS1 3HE, Leeds, UK.
Sci Rep. 2024 Feb 3;14(1):2820. doi: 10.1038/s41598-024-52743-8.
This paper proposes and executes an in-depth learning-based image processing approach for self-picking apples. The system includes a lightweight one-step detection network for fruit recognition. As well as computer vision to analyze the point class and anticipate a correct approach position for each fruit before grabbing. Using the raw inputs from a high-resolution camera, fruit recognition and instance segmentation are done on RGB photos. The computer vision classification and grasping systems are integrated and outcomes from tree-grown foods are provided as input information and output methodology poses for every apple and orange to robotic arm execution. Before RGB picture data is acquired from laboratory and plantation environments, the developed vision method will be evaluated. Robot harvest experiment is conducted in indoor as well as outdoor to evaluate the proposed harvesting system's performance. The research findings suggest that the proposed vision technique can control robotic harvesting effectively and precisely where the success rate of identification is increased above 95% in case of post prediction process with reattempts of less than 12%.
本文提出并执行了一种基于深度学习的自采苹果图像处理方法。该系统包括一个用于水果识别的轻量级一步检测网络。以及计算机视觉,用于在抓取之前分析每个水果的点类并预测正确的抓取位置。使用高分辨率相机的原始输入,在 RGB 照片上进行水果识别和实例分割。将计算机视觉分类和抓取系统集成在一起,并为每个苹果和橙子提供来自树上生长的食物的输入信息和输出方法姿势,以便机械臂执行。在从实验室和种植园环境获取 RGB 图片数据之前,将对开发的视觉方法进行评估。在室内和室外进行机器人收获实验,以评估所提出的收获系统的性能。研究结果表明,所提出的视觉技术可以有效地控制机器人收获,识别成功率高于 95%,在预测后尝试次数少于 12%的情况下,成功率更高。