Akhyar Fityanul, Liu Ying, Hsu Chao-Yung, Shih Timothy K, Lin Chih-Yang
School of Electrical Engineering, Telkom University, Bandung, West Java 40257 Indonesia.
Department of Computer Science & Engineering, Santa Clara University, Santa Clara, CA 95053 USA.
Int J Adv Manuf Technol. 2023;126(3-4):1093-1107. doi: 10.1007/s00170-023-11087-9. Epub 2023 Mar 7.
Surface defects are a common issue that affects product quality in the industrial manufacturing process. Many companies put a lot of effort into developing automated inspection systems to handle this issue. In this work, we propose a novel deep learning-based surface defect inspection system called the forceful steel defect detector (FDD), especially for steel surface defect detection. Our model adopts the state-of-the-art cascade R-CNN as the baseline architecture and improves it with the deformable convolution and the deformable RoI pooling to adapt to the geometric shape of defects. Besides, our model adopts the guided anchoring region proposal to generate bounding boxes with higher accuracies. Moreover, to enrich the point of view of input images, we propose the random scaling and the ultimate scaling techniques in the training and inference process, respectively. The experimental studies on the Severstal steel dataset, NEU steel dataset, and DAGM dataset demonstrate that our proposed model effectively improved the detection accuracy in terms of the average recall (AR) and the mean average precision (mAP) compared to state-of-the-art defect detection methods. We expect our innovation to accelerate the automation of industrial manufacturing process by increasing the productivity and by sustaining high product qualities.
表面缺陷是工业制造过程中影响产品质量的常见问题。许多公司投入大量精力开发自动化检测系统来处理这一问题。在这项工作中,我们提出了一种新颖的基于深度学习的表面缺陷检测系统,称为强力钢缺陷检测器(FDD),特别用于钢表面缺陷检测。我们的模型采用了最先进的级联R-CNN作为基线架构,并通过可变形卷积和可变形感兴趣区域池化对其进行改进,以适应缺陷的几何形状。此外,我们的模型采用引导锚定区域提议来生成精度更高的边界框。此外,为了丰富输入图像的视角,我们分别在训练和推理过程中提出了随机缩放和终极缩放技术。在Severstal钢数据集、NEU钢数据集和DAGM数据集上的实验研究表明,与最先进的缺陷检测方法相比,我们提出的模型在平均召回率(AR)和平均平均精度(mAP)方面有效提高了检测精度。我们期望我们的创新能够通过提高生产率和保持高产品质量来加速工业制造过程的自动化。