Institute of Automation, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing 100190, China.
Civil Engineering & Engineering Mechanics Department, Columbia University, New York, NY 10024, USA.
Sensors (Basel). 2020 Apr 1;20(7):1974. doi: 10.3390/s20071974.
The advent of convolutional neural networks (CNNs) has accelerated the progress of computer vision from many aspects. However, the majority of the existing CNNs heavily rely on expensive GPUs (graphics processing units). to support large computations. Therefore, CNNs have not been widely used to inspect surface defects in the manufacturing field yet. In this paper, we develop a compact CNN-based model that not only achieves high performance on tiny defect inspection but can be run on low-frequency CPUs (central processing units). Our model consists of a light-weight (LW) bottleneck and a decoder. By a pyramid of lightweight kernels, the LW bottleneck provides rich features with less computational cost. The decoder is also built in a lightweight way, which consists of an atrous spatial pyramid pooling (ASPP) and depthwise separable convolution layers. These lightweight designs reduce the redundant weights and computation greatly. We train our models on groups of surface datasets. The model can successfully classify/segment surface defects with an Intel i3-4010U CPU within 30 ms. Our model obtains similar accuracy with MobileNetV2 while only has less than its 1/3 FLOPs (floating-point operations per second) and 1/8 weights. Our experiments indicate CNNs can be compact and hardware-friendly for future applications in the automated surface inspection (ASI).
卷积神经网络(CNN)的出现从多个方面加速了计算机视觉的发展。然而,现有的大多数 CNN 严重依赖昂贵的图形处理单元(GPU)来支持大规模计算。因此,CNN 尚未广泛应用于制造业中的表面缺陷检测。在本文中,我们开发了一种基于紧凑 CNN 的模型,该模型不仅在微小缺陷检测方面具有出色的性能,而且可以在低频中央处理单元(CPU)上运行。我们的模型由轻量级(LW)瓶颈和解码器组成。通过轻量级核的金字塔,LW 瓶颈以较少的计算成本提供丰富的特征。解码器也以轻量级的方式构建,由空洞空间金字塔池化(ASPP)和深度可分离卷积层组成。这些轻量级设计大大减少了冗余权重和计算量。我们在多组表面数据集上训练我们的模型。该模型可以成功地在 30 毫秒内使用 Intel i3-4010U CPU 对表面缺陷进行分类/分割。我们的模型与 MobileNetV2 具有相似的准确性,但其 FLOPs(每秒浮点运算数)和权重分别只有其 1/3 和 1/8。我们的实验表明,CNN 可以为未来的自动化表面检测(ASI)应用提供紧凑和硬件友好的解决方案。