Kumar Debasis, Muhammad Naveed
Institute of Computer Science, University of Tartu, Narva Maantee 18, 51009 Tartu, Estonia.
Sensors (Basel). 2023 Oct 14;23(20):8471. doi: 10.3390/s23208471.
For autonomous driving, perception is a primary and essential element that fundamentally deals with the insight into the ego vehicle's environment through sensors. Perception is challenging, wherein it suffers from dynamic objects and continuous environmental changes. The issue grows worse due to interrupting the quality of perception via adverse weather such as snow, rain, fog, night light, sand storms, strong daylight, etc. In this work, we have tried to improve camera-based perception accuracy, such as autonomous-driving-related object detection in adverse weather. We proposed the improvement of YOLOv8-based object detection in adverse weather through transfer learning using merged data from various harsh weather datasets. Two prosperous open-source datasets (ACDC and DAWN) and their merged dataset were used to detect primary objects on the road in harsh weather. A set of training weights was collected from training on the individual datasets, their merged versions, and several subsets of those datasets according to their characteristics. A comparison between the training weights also occurred by evaluating the detection performance on the datasets mentioned earlier and their subsets. The evaluation revealed that using custom datasets for training significantly improved the detection performance compared to the YOLOv8 base weights. Furthermore, using more images through the feature-related data merging technique steadily increased the object detection performance.
对于自动驾驶而言,感知是一个主要且关键的要素,它从根本上通过传感器来洞察自身车辆的环境。感知具有挑战性,因为它会受到动态物体和持续环境变化的影响。由于诸如雪、雨、雾、夜光、沙尘暴、强光等恶劣天气会干扰感知质量,这个问题变得更加严重。在这项工作中,我们试图提高基于摄像头的感知精度,比如在恶劣天气下与自动驾驶相关的目标检测。我们通过使用来自各种恶劣天气数据集的合并数据进行迁移学习,提出了在恶劣天气下改进基于YOLOv8的目标检测方法。使用了两个繁荣的开源数据集(ACDC和DAWN)及其合并数据集来检测恶劣天气下道路上的主要物体。根据数据集的特征,从在各个数据集、它们的合并版本以及这些数据集的几个子集上的训练中收集了一组训练权重。还通过评估在上述数据集及其子集上的检测性能,对训练权重进行了比较。评估表明,与YOLOv8基础权重相比,使用定制数据集进行训练显著提高了检测性能。此外,通过特征相关数据合并技术使用更多图像稳步提高了目标检测性能。