Itu Razvan, Danescu Radu
Computer Science Department, Technical University of Cluj-Napoca, St. Memorandumului 28, 400114 Cluj-Napoca, Romania.
Sensors (Basel). 2023 Dec 29;24(1):212. doi: 10.3390/s24010212.
Ego-vehicle state prediction represents a complex and challenging problem for self-driving and autonomous vehicles. Sensorial information and on-board cameras are used in perception-based solutions in order to understand the state of the vehicle and the surrounding traffic conditions. Monocular camera-based methods are becoming increasingly popular for driver assistance, with precise predictions of vehicle speed and emergency braking being important for road safety enhancement, especially in the prevention of speed-related accidents. In this research paper, we introduce the implementation of a convolutional neural network (CNN) model tailored for the prediction of vehicle velocity, braking events, and emergency braking, employing sequential image sequences and velocity data as inputs. The CNN model is trained on a dataset featuring sequences of 20 consecutive images and corresponding velocity values, all obtained from a moving vehicle navigating through road-traffic scenarios. The model's primary objective is to predict the current vehicle speed, braking actions, and the occurrence of an emergency-brake situation using the information encoded in the preceding 20 frames. We subject our proposed model to an evaluation on a dataset using regression and classification metrics, and comparative analysis with existing published work based on recurrent neural networks (RNNs). Through our efforts to improve the prediction accuracy for velocity, braking behavior, and emergency-brake events, we make a substantial contribution to improving road safety and offer valuable insights for the development of perception-based techniques in the field of autonomous vehicles.
对于自动驾驶和无人驾驶车辆而言,自我车辆状态预测是一个复杂且具有挑战性的问题。基于感知的解决方案中会使用传感信息和车载摄像头,以便了解车辆状态和周围交通状况。基于单目摄像头的方法在驾驶员辅助方面越来越受欢迎,精确预测车速和紧急制动对于提高道路安全至关重要,尤其是在预防与速度相关的事故方面。在本研究论文中,我们介绍了一种卷积神经网络(CNN)模型的实现,该模型专为预测车速、制动事件和紧急制动而定制,采用连续图像序列和速度数据作为输入。CNN模型在一个数据集上进行训练,该数据集具有20个连续图像的序列以及相应的速度值,所有这些均从在道路交通场景中行驶的移动车辆获取。该模型的主要目标是利用前20帧中编码的信息来预测当前车速、制动动作以及紧急制动情况的发生。我们使用回归和分类指标在一个数据集上对我们提出的模型进行评估,并与基于递归神经网络(RNN)的现有已发表工作进行对比分析。通过我们提高车速、制动行为和紧急制动事件预测准确性的努力,我们为改善道路安全做出了重大贡献,并为自动驾驶车辆领域基于感知的技术发展提供了有价值的见解。