State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China.
Sensors (Basel). 2023 Feb 25;23(5):2563. doi: 10.3390/s23052563.
High-definition images covering entire large-scene construction sites are increasingly used for monitoring management. However, the transmission of high-definition images is a huge challenge for construction sites with harsh network conditions and scarce computing resources. Thus, an effective compressed sensing and reconstruction method for high-definition monitoring images is urgently needed. Although current deep learning-based image compressed sensing methods exhibit superior performance in recovering images from a reduced number of measurements, they still face difficulties in achieving efficient and accurate high-definition image compressed sensing with less memory usage and computational cost at large-scene construction sites. This paper investigated an efficient deep learning-based high-definition image compressed sensing framework (EHDCS-Net) for large-scene construction site monitoring, which consists of four parts, namely the sampling, initial recovery, deep recovery body, and recovery head subnets. This framework was exquisitely designed by rational organization of the convolutional, downsampling, and pixelshuffle layers based on the procedures of block-based compressed sensing. To effectively reduce memory occupation and computational cost, the framework utilized nonlinear transformations on downscaled feature maps in reconstructing images. Moreover, the efficient channel attention (ECA) module was introduced to further increase the nonlinear reconstruction capability on downscaled feature maps. The framework was tested on large-scene monitoring images from a real hydraulic engineering megaproject. Extensive experiments showed that the proposed EHDCS-Net framework not only used less memory and floating point operations (FLOPs), but it also achieved better reconstruction accuracy with faster recovery speed than other state-of-the-art deep learning-based image compressed sensing methods.
高清图像覆盖整个大型施工现场,越来越多地用于监控管理。然而,对于网络条件恶劣且计算资源稀缺的施工现场,高清图像的传输是一个巨大的挑战。因此,迫切需要一种有效的高清监控图像压缩感知和重建方法。虽然基于深度学习的图像压缩感知方法在从较少的测量值中恢复图像方面表现出优异的性能,但它们仍然难以在大型施工现场以较少的内存使用量和计算成本实现高效准确的高清图像压缩感知。本文研究了一种用于大型施工现场监测的高效基于深度学习的高清图像压缩感知框架(EHDCS-Net),该框架由四个部分组成,即采样、初始恢复、深度恢复体和恢复头子网。该框架通过基于块的压缩感知的卷积、下采样和像素混洗层的合理组织进行了精心设计。为了有效降低内存占用和计算成本,该框架在重建图像时对下采样特征图进行非线性变换。此外,引入了高效的通道注意力(ECA)模块,以进一步提高下采样特征图的非线性重建能力。该框架在来自真实水利工程大项目的大型监控图像上进行了测试。大量实验表明,所提出的 EHDCS-Net 框架不仅使用更少的内存和浮点运算(FLOPs),而且与其他最先进的基于深度学习的图像压缩感知方法相比,它还实现了更快的恢复速度和更好的重建精度。