College of Engineering, Ocean University of China, Qingdao 266100, China.
Key Laboratory for Micro/Nano Technology and System of Liaoning Province, Dalian University of Technology, Dalian 116024, China.
Sensors (Basel). 2023 Jun 15;23(12):5594. doi: 10.3390/s23125594.
Since light propagation in water bodies is subject to absorption and scattering effects, underwater images using only conventional intensity cameras will suffer from low brightness, blurred images, and loss of details. In this paper, a deep fusion network is applied to underwater polarization images; that is, the underwater polarization images are fused with intensity images using the deep learning method. To construct a training dataset, we establish an experimental setup to obtain underwater polarization images and perform appropriate transformations to expand the dataset. Next, an end-to-end learning framework based on unsupervised learning and guided by an attention mechanism is constructed for fusing polarization and light intensity images. The loss function and weight parameters are elaborated. The produced dataset is used to train the network under different loss weight parameters, and the fused images are evaluated based on different image evaluation metrics. The results show that the fused underwater images are more detailed. Compared with light intensity images, the information entropy and standard deviation of the proposed method increase by 24.48% and 139%. The image processing results are better than other fusion-based methods. In addition, the improved U-net network structure is used to extract features for image segmentation. The results show that the target segmentation based on the proposed method is feasible under turbid water. The proposed method does not require manual adjustment of weight parameters, has faster operation speed, and has strong robustness and self-adaptability, which is important for research in vision fields, such as ocean detection and underwater target recognition.
由于水体中的光传播会受到吸收和散射效应的影响,因此仅使用常规强度相机拍摄的水下图像会存在亮度低、图像模糊和细节丢失等问题。本文将深度融合网络应用于水下偏振图像,即使用深度学习方法将水下偏振图像与强度图像进行融合。为构建训练数据集,我们建立了一个实验装置来获取水下偏振图像,并进行适当的变换以扩展数据集。然后,构建了一个基于无监督学习并由注意力机制引导的端到端学习框架,用于融合偏振和光强图像。阐述了损失函数和权重参数。使用不同的损失权重参数对产生的数据集进行网络训练,并根据不同的图像评估指标评估融合图像。结果表明,融合后的水下图像更详细。与光强图像相比,所提出方法的信息熵和标准差分别增加了 24.48%和 139%。图像处理结果优于其他基于融合的方法。此外,还使用改进的 U-net 网络结构来提取图像分割的特征。结果表明,在所提出的方法下,浊水条件下的目标分割是可行的。该方法不需要手动调整权重参数,具有更快的运算速度,并且具有较强的鲁棒性和自适应性,这对于海洋探测和水下目标识别等视觉领域的研究非常重要。