Zhao Minghu, Liu Xinru, Wang Kaihang, Liu Zishen, Dong Qi, Wang Pengfei, Su Yaoheng
School of Science, Xi'an Polytechnic University, Xi'an 710048, China.
School of Electronic Information, Xi'an Polytechnic University, Xi'an 710048, China.
Sensors (Basel). 2024 Jul 19;24(14):4690. doi: 10.3390/s24144690.
A weld is the main connection form of special equipment, and a weld is also the most vulnerable part of special equipment. Therefore, an effective detection of a weld is of great significance to improve the safety of special equipment. The traditional inspection method is not only time-consuming and labor-intensive, but also expensive. The welding seam tracking and inspection robot can greatly improve the inspection efficiency and save on inspection costs. Therefore, this paper proposes a welding seam tracking and inspection robot based on YOLOv8s-seg. Firstly, the MobileNetV3 lightweight backbone network is used to replace the backbone part of YOLOv8s-seg to reduce the model parameters. Secondly, we reconstruct C2f and prune the number of output channels of the new building module C2fGhost. Finally, in order to make up for the precision loss caused by the lightweight model, we add an EMA attention mechanism after each detection layer in the neck part of the model. The experimental results show that the accuracy of weld recognition reaches 97.8%, and the model size is only 4.88 MB. The improved model is embedded in Jetson nano, a robot control system for seam tracking and detection, and TensorRT is used to accelerate the reasoning of the model. The total reasoning time from image segmentation to path fitting is only 54 ms, which meets the real-time requirements of the robot for seam tracking and detection, and realizes the path planning of the robot for inspecting the seam efficiently and accurately.
焊缝是特种设备的主要连接形式,也是特种设备最薄弱的环节。因此,对焊缝进行有效检测对于提高特种设备的安全性具有重要意义。传统的检测方法不仅耗时费力,而且成本高昂。焊缝跟踪检测机器人能够大大提高检测效率并节省检测成本。因此,本文提出一种基于YOLOv8s-seg的焊缝跟踪检测机器人。首先,使用MobileNetV3轻量级主干网络替换YOLOv8s-seg的主干部分以减少模型参数。其次,对C2f进行重构并裁剪新构建模块C2fGhost的输出通道数量。最后,为弥补轻量级模型导致的精度损失,在模型颈部的每个检测层后添加EMA注意力机制。实验结果表明,焊缝识别准确率达到97.8%,模型大小仅为4.88 MB。将改进后的模型嵌入用于焊缝跟踪检测的机器人控制系统Jetson nano中,并使用TensorRT加速模型推理。从图像分割到路径拟合的总推理时间仅为54毫秒,满足机器人对焊缝跟踪检测的实时要求,实现了机器人高效、准确地检测焊缝的路径规划。