School of Electrical and Control Engineering, Shaanxi University of Science and Technology, Xi'an 710021, China.
Sensors (Basel). 2022 Nov 3;22(21):8478. doi: 10.3390/s22218478.
In long-term use, cracks will show up on the road, delivering monetary losses and security hazards. However, the road surface with a complex background has various disturbances, so it is challenging to segment the cracks accurately. Therefore, we propose a pavement cracks segmentation method based on a conditional generative adversarial network in this paper. U-net3+ with the attention module is used in the generator to generate segmented images for pavement cracks. The attention module highlights crack features and suppresses noise features from two dimensions of channel and space, then fuses the features generated by these two dimensions to obtain more complementary crack features. The original image is stitched with the manual annotation of cracks and the generated segmented image as the input of the discriminator. The PatchGAN method is used in the discriminator. Moreover, we propose a weighted hybrid loss function to improve the segmentation accuracy by exploiting the difference between the generated and annotated images. Through alternating gaming training of the generator and the discriminator, the segmentation image of cracks generated by the generator is very close to the actual segmentation image, thus achieving the effect of crack detection. Our experimental results using the Crack500 datasets show that the proposed method can eliminate various disturbances and achieve superior performance in pavement crack detection with complex backgrounds.
在长期使用过程中,道路会出现裂缝,造成经济损失和安全隐患。然而,具有复杂背景的路面存在各种干扰,因此准确地分割裂缝具有挑战性。因此,我们提出了一种基于条件生成对抗网络的路面裂缝分割方法。生成器中使用带有注意力模块的 U-net3+ 生成用于路面裂缝的分割图像。注意力模块从通道和空间两个维度突出裂缝特征并抑制噪声特征,然后融合这两个维度生成的特征,以获得更多互补的裂缝特征。原始图像与裂缝的手动标注和生成的分割图像拼接作为判别器的输入。判别器中使用了 PatchGAN 方法。此外,我们提出了一种加权混合损失函数,通过利用生成图像和标注图像之间的差异来提高分割精度。通过交替的生成器和判别器的博弈训练,生成器生成的裂缝分割图像非常接近实际的分割图像,从而达到裂缝检测的效果。我们使用 Crack500 数据集的实验结果表明,该方法可以消除各种干扰,在具有复杂背景的路面裂缝检测中具有优异的性能。