Cui Jingwen, Zhang Jianping, Sun Guiling, Zheng Bowen
School of Electronic Information and Optical Engineering, Nankai University,Tianjin 300350, China.
Electrical Engineering and Computer Science, Northwestern University, IL 60208, USA.
Sensors (Basel). 2019 Jun 4;19(11):2553. doi: 10.3390/s19112553.
Based on computer vision technology, this paper proposes a method for identifying and locating crops in order to successfully capture crops in the process of automatic crop picking. This method innovatively combines the YOLOv3 algorithm under the DarkNet framework with the point cloud image coordinate matching method, and can achieve the goal of this paper very well. Firstly, RGB (RGB is the color representing the three channels of red, green and blue) images and depth images are obtained by using the Kinect v2 depth camera. Secondly, the YOLOv3 algorithm is used to identify the various types of target crops in the RGB images, and the feature points of the target crops are determined. Finally, the 3D coordinates of the feature points are displayed on the point cloud images. Compared with other methods, this method of crop identification has high accuracy and small positioning error, which lays a good foundation for the subsequent harvesting of crops using mechanical arms. In summary, the method used in this paper can be considered effective.
基于计算机视觉技术,本文提出了一种作物识别与定位方法,以便在自动作物采摘过程中成功捕获作物。该方法创新性地将DarkNet框架下的YOLOv3算法与点云图像坐标匹配方法相结合,能够很好地实现本文的目标。首先,使用Kinect v2深度相机获取RGB(RGB是代表红、绿、蓝三个通道的颜色)图像和深度图像。其次,利用YOLOv3算法识别RGB图像中的各类目标作物,并确定目标作物的特征点。最后,将特征点的三维坐标显示在点云图像上。与其他方法相比,这种作物识别方法具有较高的准确率和较小的定位误差,为后续使用机械臂进行作物收获奠定了良好的基础。综上所述,本文所采用的方法可被认为是有效的。