Academy of Contemporary Agricultural Engineering Innovations, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, China.
College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China.
Sensors (Basel). 2019 Sep 21;19(19):4091. doi: 10.3390/s19194091.
Due to the change of illumination environment and overlapping conditions caused by the neighboring fruits and other background objects, the simple application of the traditional machine vision method limits the detection accuracy of lychee fruits in natural orchard environments. Therefore, this research presented a detection method based on monocular machine vision to detect lychee fruits growing in overlapped conditions. Specifically, a combination of contrast limited adaptive histogram equalization (CLAHE), red/blue chromatic mapping, Otsu thresholding and morphology operations were adopted to segment the foreground regions of the lychees. A stepwise method was proposed for extracting individual lychee fruit from the lychee foreground region. The first step in this process was based on the relative position relation of the Hough circle and an equivalent area circle (equal to the area of the potential lychee foreground region) and was designed to distinguish lychee fruits growing in isolated or overlapped states. Then, a process based on the three-point definite circle theorem was performed to extract individual lychee fruits from the foreground regions of overlapped lychee fruit clusters. Finally, to enhance the robustness of the detection method, a local binary pattern support vector machine (LBP-SVM) was adopted to filter out the false positive detections generated by background chaff interferences. The performance of the presented method was evaluated using 485 images captured in a natural lychee orchard in Conghua (Area), Guangzhou. The detection results showed that the recall rate was 86.66%, the precision rate was greater than 87% and the F-score was 87.07%.
由于光照环境的变化和相邻果实及其他背景物体的重叠条件,传统机器视觉方法的简单应用限制了荔枝果实在自然果园环境中的检测精度。因此,本研究提出了一种基于单目机器视觉的检测方法,用于检测重叠条件下生长的荔枝果实。具体来说,采用对比度限制自适应直方图均衡化(CLAHE)、红蓝色度映射、Otsu 阈值和形态学操作相结合的方法来分割荔枝的前景区域。提出了一种从荔枝前景区域中提取单个荔枝果实的逐步方法。该过程的第一步基于霍夫圆和等效面积圆(等于潜在荔枝前景区域的面积)的相对位置关系,旨在区分孤立或重叠状态下生长的荔枝果实。然后,基于三点定圆定理,从重叠荔枝果实簇的前景区域中提取单个荔枝果实。最后,为了增强检测方法的鲁棒性,采用局部二值模式支持向量机(LBP-SVM)过滤掉由背景干扰产生的假阳性检测。该方法的性能使用在广州从化(地区)自然荔枝果园拍摄的 485 张图像进行了评估。检测结果表明,召回率为 86.66%,准确率大于 87%,F1 得分为 87.07%。