School of Information and Electrical Engineering, Zhejiang University City College, 51 Huzhou Street, Hangzhou 310015, China.
Hubei Key Laboratory of Ferro- & Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, 368 Youyi Street, Wuhan 430062, China.
Sensors (Basel). 2022 Mar 23;22(7):2455. doi: 10.3390/s22072455.
Aiming at the demand for rapid detection of highway pavement damage, many deep learning methods based on convolutional neural networks (CNNs) have been developed. However, CNN methods with raw image data require a high-performance hardware configuration and cost machine time. To reduce machine time and to apply the detection methods in common scenarios, the CNN structure with preprocessed image data needs to be simplified. In this work, a detection method based on a CNN and the combination of the grayscale and histogram of oriented gradients (HOG) features is proposed. First, the Gamma correction was employed to highlight the grayscale distribution of the damage area, which compresses the space of normal pavement. The preprocessed image was then divided into several unit cells, whose grayscale and HOG were calculated, respectively. The grayscale and HOG of each unit cell were combined to construct the grayscale-weighted HOG (GHOG) feature patterns. These feature patterns were input to the CNN with a specific structure and parameters. The trained indices suggested that the performance of the GHOG-based method was significantly improved, compared with the traditional HOG-based method. Furthermore, the GHOG-feature-based CNN technique exhibited flexibility and effectiveness under the same accuracy, in comparison to those deep learning techniques that directly deal with raw data. Since the grayscale has a definite physical meaning, the present detection method possesses a potential application for the further detection of damage details in the future.
针对公路路面损坏的快速检测需求,已经开发出了许多基于卷积神经网络(CNN)的深度学习方法。然而,使用原始图像数据的 CNN 方法需要高性能的硬件配置和大量的机器时间。为了减少机器时间并将检测方法应用于常见场景,需要简化使用预处理图像数据的 CNN 结构。在这项工作中,提出了一种基于 CNN 和灰度与方向梯度直方图(HOG)特征组合的检测方法。首先,采用伽马校正突出损伤区域的灰度分布,压缩正常路面的空间。然后将预处理后的图像划分为若干个单元,分别计算其灰度和 HOG。将每个单元的灰度和 HOG 组合起来,构建灰度加权 HOG(GHOG)特征模式。将这些特征模式输入到具有特定结构和参数的 CNN 中。训练指标表明,与传统的基于 HOG 的方法相比,基于 GHOG 的方法的性能有了显著提高。此外,与直接处理原始数据的深度学习技术相比,基于 GHOG 特征的 CNN 技术在相同的准确性下具有灵活性和有效性。由于灰度具有明确的物理意义,因此该检测方法具有进一步检测未来损伤细节的潜在应用。