Department of Ocean Engineering, Pukyong National University, Busan 48513, Korea.
Institute of Research and Development, Duy Tan University, Danang 550000, Vietnam.
Sensors (Basel). 2022 Apr 27;22(9):3340. doi: 10.3390/s22093340.
The performance of a neural network depends on the availability of datasets, and most deep learning techniques lack accuracy and generalization when they are trained using limited datasets. Using synthesized training data is one of the effective ways to overcome the above limitation. Besides, the previous corroded bolt detection method has focused on classifying only two classes, clean and fully rusted bolts, and its performance for detecting partially rusted bolts is still questionable. This study presents a deep learning method to identify corroded bolts in steel structures using a mask region-based convolutional neural network (Mask-RCNN) trained on synthesized data. The Resnet50 integrated with a feature pyramid network is used as the backbone for feature extraction in the Mask-RCNN-based corroded bolt detector. A four-step data synthesis procedure is proposed to autonomously generate the training datasets of corroded bolts with different severities. Afterwards, the proposed detector is trained by the synthesized datasets, and its robustness is demonstrated by detecting corroded bolts in a lab-scale steel structure under varying capturing distances and perspectives. The results show that the proposed method has detected corroded bolts well and identified their corrosion levels with the most desired overall accuracy rate = 96.3% for a 1.0 m capturing distance and 97.5% for a 15° perspective angle.
神经网络的性能取决于数据集的可用性,大多数深度学习技术在使用有限的数据集进行训练时缺乏准确性和泛化能力。使用合成训练数据是克服上述限制的有效方法之一。此外,以前的腐蚀螺栓检测方法仅专注于分类两种情况,即干净和完全生锈的螺栓,其对部分生锈螺栓的检测性能仍存在疑问。本研究提出了一种基于掩模区域的卷积神经网络(Mask-RCNN)的深度学习方法,使用合成数据对其进行训练,以识别钢结构中的腐蚀螺栓。Resnet50 与特征金字塔网络集成作为基于 Mask-RCNN 的腐蚀螺栓探测器的特征提取的骨干网络。提出了一个四步数据合成过程,以自动生成不同严重程度的腐蚀螺栓的训练数据集。然后,使用合成数据集对所提出的探测器进行训练,并通过在不同拍摄距离和角度下检测实验室规模钢结构中的腐蚀螺栓来证明其鲁棒性。结果表明,该方法能够很好地检测腐蚀螺栓,并识别其腐蚀程度,在 1.0 米拍摄距离和 15°视角下,整体准确率达到了 96.3%。