School of Mechanical Engineering, Pusan National University, Busan 46241, Korea.
Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA.
Sensors (Basel). 2021 Nov 22;21(22):7769. doi: 10.3390/s21227769.
Road surface detection is important for safely driving autonomous vehicles. This is because the knowledge of road surface conditions, in particular, dry, wet, and snowy surfaces, should be considered for driving control of autonomous vehicles. With the rise of deep learning technology, road surface detection methods using deep neural networks (DNN) have been widely used for developing road surface detection algorithms. To apply DNN in road surface detection, the dataset should be large and well-balanced for accurate and robust performance. However, most of the images of road surfaces obtained through usual data collection processes are not well-balanced. Most of the collected surface images tend to be of dry surfaces because road surface conditions are highly correlated with weather conditions. This could be a challenge in developing road surface detection algorithms. This paper proposes a method to balance the imbalanced dataset using CycleGAN to improve the performance of a road surface detection algorithm. CycleGAN was used to artificially generate images of wet and snow-covered roads. The road surface detection algorithm trained using the CycleGAN-augmented dataset had a better IoU than the method using imbalanced basic datasets. This result shows that CycleGAN-generated images can be used as datasets for road surface detection to improve the performance of DNN, and this method can help make the data acquisition process easy.
路面检测对于自动驾驶汽车的安全行驶至关重要。这是因为应该考虑到路面状况的知识,特别是干燥、潮湿和积雪路面,以进行自动驾驶车辆的驾驶控制。随着深度学习技术的兴起,使用深度神经网络(DNN)的路面检测方法已被广泛用于开发路面检测算法。为了在路面检测中应用 DNN,数据集应该足够大和平衡,以实现准确和稳健的性能。然而,通过常规数据收集过程获得的大多数路面图像都不平衡。大多数收集到的表面图像往往是干燥表面的,因为路面状况与天气状况高度相关。这可能是开发路面检测算法的一个挑战。本文提出了一种使用 CycleGAN 来平衡不平衡数据集的方法,以提高路面检测算法的性能。CycleGAN 被用于人为生成湿路和积雪路面的图像。使用 CycleGAN 增强数据集训练的路面检测算法的 IoU 优于使用不平衡基础数据集的方法。这一结果表明,CycleGAN 生成的图像可用于路面检测数据集,以提高 DNN 的性能,并且该方法可以帮助简化数据采集过程。