Jiang Tianyou, Yu Qun, Zhong Yang, Shao Mingshun
College of Information Science and Engineering, Shandong Agricultural University, Tai'an 271018, China.
Huanghuaihai Key Laboratory of Smart Agricultural Technology, Ministry of Agriculture and Rural Affairs, Tai'an 271018, China.
J Imaging. 2024 Jun 6;10(6):137. doi: 10.3390/jimaging10060137.
Recent advancements in computer vision, especially deep learning models, have shown considerable promise in tasks related to plant image object detection. However, the efficiency of these deep learning models heavily relies on input image quality, with low-resolution images significantly hindering model performance. Therefore, reconstructing high-quality images through specific techniques will help extract features from plant images, thus improving model performance. In this study, we explored the value of super-resolution technology for improving object detection model performance on plant images. Firstly, we built a comprehensive dataset comprising 1030 high-resolution plant images, named the PlantSR dataset. Subsequently, we developed a super-resolution model using the PlantSR dataset and benchmarked it against several state-of-the-art models designed for general image super-resolution tasks. Our proposed model demonstrated superior performance on the PlantSR dataset, indicating its efficacy in enhancing the super-resolution of plant images. Furthermore, we explored the effect of super-resolution on two specific object detection tasks: apple counting and soybean seed counting. By incorporating super-resolution as a pre-processing step, we observed a significant reduction in mean absolute error. Specifically, with the YOLOv7 model employed for apple counting, the mean absolute error decreased from 13.085 to 5.71. Similarly, with the P2PNet-Soy model utilized for soybean seed counting, the mean absolute error decreased from 19.159 to 15.085. These findings underscore the substantial potential of super-resolution technology in improving the performance of object detection models for accurately detecting and counting specific plants from images. The source codes and associated datasets related to this study are available at Github.
计算机视觉领域的最新进展,尤其是深度学习模型,在与植物图像目标检测相关的任务中显示出了巨大的潜力。然而,这些深度学习模型的效率严重依赖于输入图像的质量,低分辨率图像会显著阻碍模型性能。因此,通过特定技术重建高质量图像将有助于从植物图像中提取特征,从而提高模型性能。在本研究中,我们探索了超分辨率技术对提高植物图像目标检测模型性能的价值。首先,我们构建了一个包含1030张高分辨率植物图像的综合数据集,命名为PlantSR数据集。随后,我们使用PlantSR数据集开发了一个超分辨率模型,并将其与几个为一般图像超分辨率任务设计的先进模型进行了基准测试。我们提出的模型在PlantSR数据集上表现出卓越的性能,表明其在增强植物图像超分辨率方面的有效性。此外,我们还探索了超分辨率对两个特定目标检测任务的影响:苹果计数和大豆种子计数。通过将超分辨率作为预处理步骤,我们观察到平均绝对误差显著降低。具体而言,在用于苹果计数的YOLOv7模型中,平均绝对误差从13.085降至5.71。同样,在用于大豆种子计数的P2PNet-Soy模型中,平均绝对误差从19.159降至15.085。这些发现强调了超分辨率技术在提高目标检测模型性能方面的巨大潜力,该模型可用于从图像中准确检测和计数特定植物。与本研究相关的源代码和数据集可在Github上获取。