Wang Jiuxin, Huang Lei, Yao Jiahui, Liu Man, Du Yurong, Zhao Minghu, Su Yaoheng, Lu Dingze
School of Science, Xi'an Polytechnic University, Xi'an 710048, China.
School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China.
Sensors (Basel). 2023 Jul 27;23(15):6725. doi: 10.3390/s23156725.
The regular detection of weld seams in large-scale special equipment is crucial for improving safety and efficiency, and this can be achieved effectively through the use of weld seam tracking and detection robots. In this study, a wall-climbing robot with integrated seam tracking and detection was designed, and the wall climbing function was realized via a permanent magnet array and a Mecanum wheel. The function of weld seam tracking and detection was realized using a DeepLabv3+ semantic segmentation model. Several optimizations were implemented to enhance the deployment of the DeepLabv3+ semantic segmentation model on embedded devices. Mobilenetv2 was used to replace the feature extraction network of the original model, and the convolutional block attention module attention mechanism was introduced into the encoder module. All traditional 3×3 convolutions were substituted with depthwise separable dilated convolutions. Subsequently, the welding path was fitted using the least squares method based on the segmentation results. The experimental results showed that the volume of the improved model was reduced by 92.9%, only being 21.8 Mb. The average precision reached 98.5%, surpassing the original model by 1.4%. The reasoning speed was accelerated to 21 frames/s, satisfying the real-time requirements of industrial detection. The detection robot successfully realizes the autonomous identification and tracking of weld seams. This study remarkably contributes to the development of automatic and intelligent weld seam detection technologies.
在大型特种设备中定期检测焊缝对于提高安全性和效率至关重要,而通过使用焊缝跟踪与检测机器人能够有效实现这一点。在本研究中,设计了一种集成焊缝跟踪与检测功能的爬壁机器人,其爬壁功能通过永磁阵列和麦克纳姆轮实现。焊缝跟踪与检测功能则利用DeepLabv3+语义分割模型来实现。为了增强DeepLabv3+语义分割模型在嵌入式设备上的部署,实施了多项优化措施。使用Mobilenetv2替换原始模型的特征提取网络,并将卷积块注意力模块注意力机制引入编码器模块。将所有传统的3×3卷积替换为深度可分离扩张卷积。随后,基于分割结果使用最小二乘法拟合焊接路径。实验结果表明,改进模型的体积减少了92.9%,仅为21.8 Mb。平均精度达到98.5%,比原始模型提高了1.4%。推理速度加快到21帧/秒,满足了工业检测的实时要求。该检测机器人成功实现了焊缝的自主识别与跟踪。本研究为自动和智能焊缝检测技术的发展做出了显著贡献。