Rodríguez-Rodríguez José A, López-Rubio Ezequiel, Ángel-Ruiz Juan A, Molina-Cabello Miguel A
Department of Computer Languages and Computer Science, University of Málaga, 29071 Málaga, Spain.
Instituto de Investigación Biomédica de Málaga y Plataforma en Nanomedicina-IBIMA Plataforma BIONAND, 29009 Málaga, Spain.
Sensors (Basel). 2024 Jan 26;24(3):821. doi: 10.3390/s24030821.
The application of deep learning to image and video processing has become increasingly popular nowadays. Employing well-known pre-trained neural networks for detecting and classifying objects in images is beneficial in a wide range of application fields. However, diverse impediments may degrade the performance achieved by those neural networks. Particularly, Gaussian noise and brightness, among others, may be presented on images as sensor noise due to the limitations of image acquisition devices. In this work, we study the effect of the most representative noise types and brightness alterations on images in the performance of several state-of-the-art object detectors, such as YOLO or Faster-RCNN. Different experiments have been carried out and the results demonstrate how these adversities deteriorate their performance. Moreover, it is found that the size of objects to be detected is a factor that, together with noise and brightness factors, has a considerable impact on their performance.
如今,深度学习在图像和视频处理中的应用越来越普遍。使用知名的预训练神经网络对图像中的物体进行检测和分类,在广泛的应用领域中都很有益。然而,各种障碍可能会降低这些神经网络的性能。特别是,由于图像采集设备的限制,高斯噪声和亮度等可能会作为传感器噪声出现在图像上。在这项工作中,我们研究了几种最具代表性的噪声类型和亮度变化对图像的影响,这些影响作用于几种先进的目标检测器(如YOLO或Faster-RCNN)的性能。我们进行了不同的实验,结果表明这些不利因素是如何降低其性能的。此外,研究发现,待检测物体的大小是一个与噪声和亮度因素共同对其性能产生重大影响的因素。