Department of Electronic Engineering, Korea National University of Transportation, 50 Daehak-ro, Chungju-si, Chungbuk 27469, Korea.
School of Intelligent Mechatronics Engineering, Sejong University, 209 Neungdong-ro, Gwangjin-gu, Seoul 05006, Korea.
Sensors (Basel). 2018 Sep 5;18(9):2956. doi: 10.3390/s18092956.
This paper proposes a method that automatically calibrates four cameras of an around view monitor (AVM) system in a natural driving situation. The proposed method estimates orientation angles of four cameras composing the AVM system, and assumes that their locations and intrinsic parameters are known in advance. This method utilizes lane markings because they exist in almost all on-road situations and appear across images of adjacent cameras. It starts by detecting lane markings from images captured by four cameras of the AVM system in a cost-effective manner. False lane markings are rejected by analyzing the statistical properties of the detected lane markings. Once the correct lane markings are sufficiently gathered, this method first calibrates the front and rear cameras, and then calibrates the left and right cameras with the help of the calibration results of the front and rear cameras. This two-step approach is essential because side cameras cannot be fully calibrated by themselves, due to insufficient lane marking information. After this initial calibration, this method collects corresponding lane markings appearing across images of adjacent cameras and simultaneously refines the initial calibration results of four cameras to obtain seamless AVM images. In the case of a long image sequence, this method conducts the camera calibration multiple times, and then selects the medoid as the final result to reduce computational resources and dependency on a specific place. In the experiment, the proposed method was quantitatively and qualitatively evaluated in various real driving situations and showed promising results.
本文提出了一种在自然驾驶情况下自动校准环视监控(AVM)系统四个摄像机的方法。该方法估计构成 AVM 系统的四个摄像机的方向角,并假设它们的位置和内部参数预先已知。该方法利用车道标记,因为它们几乎存在于所有道路情况中,并出现在相邻摄像机的图像中。它首先以具有成本效益的方式从 AVM 系统的四个摄像机拍摄的图像中检测车道标记。通过分析检测到的车道标记的统计特性来拒绝错误的车道标记。一旦收集到足够的正确车道标记,该方法首先校准前后摄像机,然后借助前、后摄像机的校准结果来校准左右摄像机。这种两步法是必要的,因为由于侧视摄像机的车道标记信息不足,无法单独对其进行完全校准。初始校准后,该方法收集出现在相邻摄像机图像中的相应车道标记,并同时对四个摄像机的初始校准结果进行细化,以获得无缝 AVM 图像。在长图像序列的情况下,该方法多次进行摄像机校准,然后选择中值作为最终结果,以减少计算资源和对特定位置的依赖。在实验中,该方法在各种实际驾驶情况下进行了定量和定性评估,结果令人满意。