Qi Chao, Gao Junfeng, Chen Kunjie, Shu Lei, Pearson Simon
College of Engineering, Nanjing Agricultural University, Nanjing, China.
Lincoln Agri-Robotics Centre, Lincoln Institute for Agri-Food Technology, University of Lincoln, Lincoln, United Kingdom.
Front Plant Sci. 2022 Apr 7;13:850606. doi: 10.3389/fpls.2022.850606. eCollection 2022.
A high resolution dataset is one of the prerequisites for tea chrysanthemum detection with deep learning algorithms. This is crucial for further developing a selective chrysanthemum harvesting robot. However, generating high resolution datasets of the tea chrysanthemum with complex unstructured environments is a challenge. In this context, we propose a novel tea chrysanthemum - generative adversarial network (TC-GAN) that attempts to deal with this challenge. First, we designed a non-linear mapping network for untangling the features of the underlying code. Then, a customized regularization method was used to provide fine-grained control over the image details. Finally, a gradient diversion design with multi-scale feature extraction capability was adopted to optimize the training process. The proposed TC-GAN was compared with 12 state-of-the-art generative adversarial networks, showing that an optimal average precision (AP) of 90.09% was achieved with the generated images (512 × 512) on the developed TC-YOLO object detection model under the NVIDIA Tesla P100 GPU environment. Moreover, the detection model was deployed into the embedded NVIDIA Jetson TX2 platform with 0.1 s inference time, and this edge computing device could be further developed into a perception system for selective chrysanthemum picking robots in the future.
高分辨率数据集是使用深度学习算法进行茶菊花检测的前提条件之一。这对于进一步开发选择性菊花采摘机器人至关重要。然而,生成具有复杂非结构化环境的茶菊花高分辨率数据集是一项挑战。在此背景下,我们提出了一种新颖的茶菊花生成对抗网络(TC-GAN),试图应对这一挑战。首先,我们设计了一个非线性映射网络来解开底层代码的特征。然后,使用一种定制的正则化方法对图像细节进行细粒度控制。最后,采用具有多尺度特征提取能力的梯度转移设计来优化训练过程。将所提出的TC-GAN与12种先进的生成对抗网络进行比较,结果表明,在NVIDIA Tesla P100 GPU环境下,在开发的TC-YOLO目标检测模型上,生成的图像(512×512)实现了90.09%的最佳平均精度(AP)。此外,该检测模型被部署到嵌入式NVIDIA Jetson TX2平台上,推理时间为0.1秒,这种边缘计算设备未来可进一步开发成为选择性菊花采摘机器人的感知系统。