Wang Xiaobin, Zhang Qiang, Chen Chengjun
School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao, 266520, Shandong, China.
Sci Rep. 2024 May 13;14(1):10886. doi: 10.1038/s41598-024-61324-8.
In the production process, the presence of surface defects seriously affects the quality of industrial products. Existing defect detectors are not suitable for surface with scattered distribution and complex texture of defects. In this study, a dual-branch information extraction and local attention anchor-free network for defect detection (DLA-FCOS), which is based on the fully convolutional one-stage network, is proposed to accurately locate and detect surface defects of industrial products. Firstly, a dual-branch feature extraction network (DFENeT) is proposed and used to improve the extraction ability of complex defects. Then, a local feature enhancement module is proposed, and a residual connection is established to enrich local semantic information. Meanwhile, the self-attention mechanism is introduced to form local attentional residual feature pyramid networks (LA-RFPN) to eliminate the influences of feature misalignments. The mean average accuracy (mAP) and frames per second (FPS) of the proposed DLA-FCOS on the cut layer of the tobacco packet defect dataset (CLTP-DD) are 96.8% and 20.7, respectively, which meets the requirements for accurate and real-time defect detection. Meanwhile, the average accuracy of the proposed DLA-FCOS on the NEU-DET and GC10-DET datasets is 78.4% and 67.7%, respectively. The results demonstrate that the DLA-FCOS has good feasibility and high generalization capability to perform defect detection tasks of industrial products.
在生产过程中,表面缺陷的存在严重影响工业产品质量。现有的缺陷检测器不适用于缺陷呈分散分布且纹理复杂的表面。在本研究中,提出了一种基于全卷积单阶段网络的用于缺陷检测的双分支信息提取与局部注意力无锚网络(DLA-FCOS),以准确地定位和检测工业产品的表面缺陷。首先,提出了一种双分支特征提取网络(DFENeT)并用于提高对复杂缺陷的提取能力。然后,提出了一个局部特征增强模块,并建立了残差连接以丰富局部语义信息。同时,引入自注意力机制以形成局部注意力残差特征金字塔网络(LA-RFPN)来消除特征错位的影响。所提出的DLA-FCOS在烟包缺陷数据集的切割层(CLTP-DD)上的平均精度均值(mAP)和每秒帧数(FPS)分别为96.8%和20.7,满足精确和实时缺陷检测的要求。同时,所提出的DLA-FCOS在NEU-DET和GC10-DET数据集上的平均精度分别为78.4%和67.7%。结果表明,DLA-FCOS在执行工业产品的缺陷检测任务方面具有良好的可行性和较高的泛化能力。