Cognitive Neuroinformatics, University of Bremen, Enrique-Schmidt-Straße 5, 28359 Bremen, Germany.
Sensors (Basel). 2021 Oct 14;21(20):6825. doi: 10.3390/s21206825.
Bottom-up saliency models identify the salient regions of an image based on features such as color, intensity and orientation. These models are typically used as predictors of human visual behavior and for computer vision tasks. In this paper, we conduct a systematic evaluation of the saliency maps computed with four selected bottom-up models on images of urban and highway traffic scenes. Saliency both over whole images and on object level is investigated and elaborated in terms of the energy and the entropy of the saliency maps. We identify significant differences with respect to the amount, size and shape-complexity of the salient areas computed by different models. Based on these findings, we analyze the likelihood that object instances fall within the salient areas of an image and investigate the agreement between the segments of traffic participants and the saliency maps of the different models. The overall and object-level analysis provides insights on the distinctive features of salient areas identified by different models, which can be used as selection criteria for prospective applications in autonomous driving such as object detection and tracking.
自底向上的显著度模型基于颜色、强度和方向等特征来识别图像的显著区域。这些模型通常被用作人类视觉行为的预测器和计算机视觉任务的预测器。在本文中,我们对四种选定的自底向上模型在城市和高速公路交通场景图像上计算的显著图进行了系统评估。研究并阐述了整体图像和对象级别的显著度,分别从显著图的能量和熵的角度进行分析。我们发现不同模型计算出的显著区域的数量、大小和形状复杂度存在显著差异。基于这些发现,我们分析了对象实例落在图像显著区域的可能性,并研究了不同模型的交通参与者片段与显著图之间的一致性。整体和对象级别的分析提供了不同模型识别的显著区域的独特特征的深入了解,这些特征可作为自主驾驶中目标检测和跟踪等潜在应用的选择标准。