Bonatti Amedeo Franco, Vozzi Giovanni, Chua Chee Kai, Maria Carmelo De
Department of Information Engineering and Research Center "Enrico Piaggio," University of Pisa, Pisa, Italy.
Engineering Product Development Pillar, Singapore University of Technology and Design, Singapore.
Int J Bioprint. 2022 Oct 11;8(4):620. doi: 10.18063/ijb.v8i4.620. eCollection 2022.
Extrusion-based bioprinting (EBB) represents one of the most used deposition technologies in the field of bioprinting, thanks to key advantages such as the easy-to-use hardware and the wide variety of materials that can be successfully printed. In recent years, research efforts have been focused on implementing a quality control loop for EBB, which can reduce the trial-and-error process necessary to optimize the printing parameters for a specific ink, standardize the results of a print across multiple laboratories, and so accelerate the translation of extrusion bioprinted products to more impactful clinical applications. Due to its capacity to acquire relevant features from a training dataset and generalize to unseen data, machine learning (ML) is currently being studied in literature as a relevant enabling technology for quality control in EBB. In this context, we propose a robust, deep learning-based control loop to automatically optimize the printing parameters and monitor the printing process online. We collected a comprehensive dataset of EBB prints by recording the process with a high-resolution webcam. To model multiple printing scenarios, each video represents a combination of multiple parameters, including printing set-up (either mechanical or pneumatic extrusion), material color, layer height, and infill density. After pre-processing, the collected dataset was used to thoroughly train and evaluate an defined convolutional neural network by controlling over-fitting and optimizing the prediction time of the network. Finally, the ML model was used in a control loop to: (i) monitor the printing process and detect if a print with an error could be stopped before completion to save material and time and (ii) automatically optimize the printing parameters by combining the ML model with a previously published mathematical model of the EBB process. Altogether, we demonstrated for the first time how ML techniques can be used to automatize the EBB process, paving the way for a total quality control loop of the printing process.
基于挤压的生物打印(EBB)是生物打印领域最常用的沉积技术之一,这得益于其易于使用的硬件以及能够成功打印的多种材料等关键优势。近年来,研究工作主要集中在为EBB实施质量控制回路,这可以减少针对特定墨水优化打印参数所需的反复试验过程,使多个实验室的打印结果标准化,从而加速挤压生物打印产品向更具影响力的临床应用转化。由于机器学习(ML)能够从训练数据集中获取相关特征并推广到未见数据,目前文献中正在研究将其作为EBB质量控制的一项相关使能技术。在此背景下,我们提出了一个基于深度学习的强大控制回路,以自动优化打印参数并在线监测打印过程。我们通过使用高分辨率网络摄像头记录过程,收集了EBB打印的综合数据集。为了对多种打印场景进行建模,每个视频代表多个参数的组合,包括打印设置(机械挤压或气动挤压)、材料颜色、层高和填充密度。经过预处理后,收集到的数据集被用于通过控制过拟合和优化网络的预测时间来全面训练和评估一个定义好的卷积神经网络。最后,ML模型被用于一个控制回路中,以:(i)监测打印过程,并检测是否可以在打印出错之前停止,以节省材料和时间;(ii)通过将ML模型与先前发表的EBB过程数学模型相结合,自动优化打印参数。总之,我们首次展示了ML技术如何用于使EBB过程自动化,为打印过程的全面质量控制回路铺平了道路。