Suppr超能文献

基于熔池视频多尺度特征融合的焊接缺陷监测

Welding Defect Monitoring Based on Multi-Scale Feature Fusion of Molten Pool Videos.

作者信息

Shi Chenbo, Wang Lei, Zhu Changsheng, Han Tengyue, Zhang Xiangyu, Wang Delin, Zhang Chun

机构信息

College of lntelligent Equipment, Shandong University of Science and Technology, Taian 271019, China.

Beijing Botsing Technology Co., Ltd., Beijing 100176, China.

出版信息

Sensors (Basel). 2024 Oct 11;24(20):6561. doi: 10.3390/s24206561.

Abstract

Real-time quality monitoring through molten pool images is a critical focus in researching high-quality, intelligent automated welding. However, challenges such as the dynamic nature of the molten pool, changes in camera perspective, and variations in pool shape make defect detection using single-frame images difficult. We propose a multi-scale fusion method for defect monitoring based on molten pool videos to address these issues. This method analyzes the temporal changes in light spots on the molten pool surface, transferring features between frames to capture dynamic behavior. Our approach employs multi-scale feature fusion using row and column convolutions along with a gated fusion module to accommodate variations in pool size and position, enabling the detection of light spot changes of different sizes and directions from coarse to fine. Additionally, incorporating mixed attention with row and column features enables the model to capture the characteristics of the molten pool more efficiently. Our method achieves an accuracy of 97.416% on a molten pool video dataset, with a processing time of 16 ms per sample. Experimental results on the UCF101-24 and JHMDB datasets also demonstrate the method's generalization capability.

摘要

通过熔池图像进行实时质量监测是高质量智能自动化焊接研究的关键重点。然而,熔池的动态特性、相机视角的变化以及熔池形状的差异等挑战使得使用单帧图像进行缺陷检测变得困难。为了解决这些问题,我们提出了一种基于熔池视频的缺陷监测多尺度融合方法。该方法分析熔池表面光斑的时间变化,在帧间传递特征以捕捉动态行为。我们的方法采用行卷积和列卷积以及门控融合模块进行多尺度特征融合,以适应熔池大小和位置的变化,从而能够从粗到细地检测不同大小和方向的光斑变化。此外,将混合注意力与行特征和列特征相结合,使模型能够更有效地捕捉熔池的特征。我们的方法在熔池视频数据集上的准确率达到了97.416%,每个样本的处理时间为16毫秒。在UCF101 - 24和JHMDB数据集上的实验结果也证明了该方法的泛化能力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f07a/11511041/c5e8642a2e04/sensors-24-06561-g001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验