Zhang Chi, Cui Jian, Liu Wei
Department of Industrial Engineering and Management, Peking University, Beijing 100871, China.
China Mobile Research Institute, Beijing 100053, China.
Comput Intell Neurosci. 2022 Oct 3;2022:2549683. doi: 10.1155/2022/2549683. eCollection 2022.
The development of industry is inseparable from the support of steel materials, and the modern industry has increasingly high requirements for the quality of steel plates. But the process of steel plate production produces many types of defects, such as roll marks, scratches, and scars. These defects will directly affect the quality and performance of the steel plate, so it is necessary to effectively detect them. Steel plate surface defects are characterized by their types, shape, and size: the same defect can have different morphologies, and similarities can exist between different defects. In this paper, industrial steel plate surface defect samples are analyzed, and a sample set is established by screening the collected defect images. Then, annotation and classification are performed. A multilayer feature extraction framework is developed in experiments to train a neural network on the sample set of defects. To address the problems of low automation, slow detection speed, and low accuracy of the traditional defect detection methods, the attention graph convolution network (AGCN) is investigated in this paper. Firstly, faster R-CNN is used as the basic network model for defect detection, and the visual features are jointly refined by combining attention mechanism and graph convolution neural network. The latter network enriches the contextual information in the visual features of steel plates and explores the semantic association between vision and defect types for different kinds of defects using the attention mechanism to achieve intelligent detection of defects, thus enabling our method to meet the practical needs of steel plate production.
工业的发展离不开钢材的支撑,现代工业对钢板质量的要求越来越高。但钢板生产过程中会产生多种缺陷,如辊印、划痕和疤痕等。这些缺陷会直接影响钢板的质量和性能,因此有必要对其进行有效检测。钢板表面缺陷具有类型、形状和尺寸等特征:同一缺陷可能有不同的形态,不同缺陷之间也可能存在相似性。本文对工业钢板表面缺陷样本进行分析,通过筛选收集到的缺陷图像建立样本集,然后进行标注和分类。实验中开发了一种多层特征提取框架,在缺陷样本集上训练神经网络。针对传统缺陷检测方法自动化程度低、检测速度慢和准确率低的问题,本文研究了注意力图卷积网络(AGCN)。首先,使用更快的R-CNN作为缺陷检测的基础网络模型,通过结合注意力机制和图卷积神经网络对视觉特征进行联合优化。后者网络丰富了钢板视觉特征中的上下文信息,并利用注意力机制探索不同类型缺陷的视觉与缺陷类型之间的语义关联,以实现缺陷的智能检测,从而使我们的方法能够满足钢板生产的实际需求。