Luo Yawen, Chen Yuhua
Department of Electrical and Computer Engineering, University of Houston, Houston, TX 77204, USA.
Sensors (Basel). 2021 Mar 18;21(6):2123. doi: 10.3390/s21062123.
Additive manufacturing (AM) has gained increasing attention over the past years due to its fast prototype, easier modification, and possibility for complex internal texture devices when compared to traditional manufacture processing. However, potential internal defects are occurring during AM processes, and it requires real-time inspections to minimize the costs by either aborting the processing or repairing the defect. In order to perform the defects inspection, first the defects database NEU-DET is used for training. Then, a convolution neural network (CNN) is applied to perform defects classification. For real-time purposes, Field Programmable Gate Arrays (FPGAs) are utilized for acceleration. A binarized neural network (BNN) is proposed to best fit the FPGA bit operations. Finally, for the image labeled with defects, the selective search and non-maximum algorithms are implemented to help locate the coordinates of defects. Experiments show that the BNN model on NEU-DET can achieve 97.9% accuracy in identifying whether the image is defective or defect-free. As for the image classification speed, the FPGA-based BNN module can process one image within 0.5 s. The BNN design is modularized and can be duplicated in parallel to fully utilize logic gates and memory resources in FPGAs. It is clear that the proposed FPGA-based BNN can perform real-time defects inspection with high accuracy and it can easily scale up to larger FPGA implementations.
与传统制造工艺相比,增材制造(AM)在过去几年中受到了越来越多的关注,因为它具有快速成型、易于修改以及制造具有复杂内部结构的器件的可能性。然而,在增材制造过程中会出现潜在的内部缺陷,这就需要进行实时检测,以便通过中止加工或修复缺陷来将成本降至最低。为了进行缺陷检测,首先使用缺陷数据库NEU-DET进行训练。然后,应用卷积神经网络(CNN)进行缺陷分类。出于实时性的目的,利用现场可编程门阵列(FPGA)进行加速。提出了一种二值化神经网络(BNN)以最佳地适配FPGA的位操作。最后,对于标记有缺陷的图像,实施选择性搜索和非极大值算法以帮助定位缺陷的坐标。实验表明,基于NEU-DET的BNN模型在识别图像是否有缺陷方面可达到97.9%的准确率。至于图像分类速度,基于FPGA的BNN模块可以在0.5秒内处理一幅图像。BNN设计是模块化的,可以并行复制以充分利用FPGA中的逻辑门和内存资源。显然,所提出的基于FPGA的BNN能够以高精度进行实时缺陷检测,并且可以轻松扩展到更大规模的FPGA实现。