Goh Guo Dong, Hamzah Nur Muizzu Bin, Yeong Wai Yee
Singapore Centre for 3D Printing, School of Mechanical & Aerospace Engineering, Nanyang Technological University Singapore, Singapore, Singapore.
HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore, Singapore.
3D Print Addit Manuf. 2023 Jun 1;10(3):428-437. doi: 10.1089/3dp.2021.0231. Epub 2023 Jun 8.
Fused filament fabrication (FFF) has been widely used in various industries, and the adoption of technology is growing significantly. However, the FFF process has several disadvantages like inconsistent part quality and print repeatability. The occurrence of manufacturing-induced defects often leads to these shortcomings. This study aims to develop and implement an on-site monitoring system, which consists of a camera attached to the print head and the laptop that processes the video feed, for the extrusion-based 3D printers incorporating computer vision and object detection models to detect defects and make corrections in real-time. Image data from two classes of defects were collected to train the model. Various YOLO architectures were evaluated to study the ability to detect and classify printing anomalies such as under-extrusion and over-extrusion. Four of the trained models, YOLOv3 and YOLOv4 with "Tiny" variation, achieved a mean average precision score of >80% using the AP50 metric. Subsequently, two of the models (YOLOv3-Tiny 100 and 300 epochs) were optimized using Open Neural Network Exchange (ONNX) model conversion and ONNX Runtime to improve the inference speed. A classification accuracy rate of 89.8% and an inference speed of 70 frames per second were obtained. Before implementing the on-site monitoring system, a correction algorithm was developed to perform simple corrective actions based on defect classification. The G-codes of the corrective actions were sent to the printers during the printing process. This implementation successfully demonstrated real-time monitoring and autonomous correction during the FFF 3D printing process. This implementation will pave the way for an on-site monitoring and correction system through closed-loop feedback from other additive manufacturing (AM) processes.
熔融沉积成型(FFF)已在各个行业中广泛使用,并且该技术的采用率正在显著增长。然而,FFF工艺存在一些缺点,如零件质量不一致和打印重复性差。制造过程中产生的缺陷往往导致了这些不足。本研究旨在开发并实施一种现场监测系统,该系统由一个连接到打印头的摄像头和一台处理视频馈送的笔记本电脑组成,用于基于挤出的3D打印机,结合计算机视觉和目标检测模型来实时检测缺陷并进行校正。收集了两类缺陷的图像数据来训练模型。评估了各种YOLO架构,以研究检测和分类诸如欠挤出和过挤出等打印异常的能力。使用AP50指标,四个经过训练的模型,即带有“Tiny”变体的YOLOv3和YOLOv4,平均精度得分>80%。随后,使用开放神经网络交换(ONNX)模型转换和ONNX运行时对其中两个模型(YOLOv3-Tiny 100和300轮次)进行了优化,以提高推理速度。获得了89.8%的分类准确率和每秒70帧的推理速度。在实施现场监测系统之前,开发了一种校正算法,以根据缺陷分类执行简单的校正操作。在打印过程中,将校正操作的G代码发送到打印机。该实施成功展示了FFF 3D打印过程中的实时监测和自主校正。该实施将通过来自其他增材制造(AM)工艺的闭环反馈,为现场监测和校正系统铺平道路。