• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于水下图像增强及其他领域的孪生对抗对比学习

Twin Adversarial Contrastive Learning for Underwater Image Enhancement and Beyond.

作者信息

Liu Risheng, Jiang Zhiying, Yang Shuzhou, Fan Xin

出版信息

IEEE Trans Image Process. 2022;31:4922-4936. doi: 10.1109/TIP.2022.3190209. Epub 2022 Jul 22.

DOI:10.1109/TIP.2022.3190209
PMID:35849672
Abstract

Underwater images suffer from severe distortion, which degrades the accuracy of object detection performed in an underwater environment. Existing underwater image enhancement algorithms focus on the restoration of contrast and scene reflection. In practice, the enhanced images may not benefit the effectiveness of detection and even lead to a severe performance drop. In this paper, we propose an object-guided twin adversarial contrastive learning based underwater enhancement method to achieve both visual-friendly and task-orientated enhancement. Concretely, we first develop a bilateral constrained closed-loop adversarial enhancement module, which eases the requirement of paired data with the unsupervised manner and preserves more informative features by coupling with the twin inverse mapping. In addition, to confer the restored images with a more realistic appearance, we also adopt the contrastive cues in the training phase. To narrow the gap between visually-oriented and detection-favorable target images, a task-aware feedback module is embedded in the enhancement process, where the coherent gradient information of the detector is incorporated to guide the enhancement towards the detection-pleasing direction. To validate the performance, we allocate a series of prolific detectors into our framework. Extensive experiments demonstrate that the enhanced results of our method show remarkable amelioration in visual quality, the accuracy of different detectors conducted on our enhanced images has been promoted notably. Moreover, we also conduct a study on semantic segmentation to illustrate how object guidance improves high-level tasks. Code and models are available at https://github.com/Jzy2017/TACL.

摘要

水下图像存在严重失真,这会降低在水下环境中进行目标检测的准确性。现有的水下图像增强算法主要集中在对比度恢复和场景反射方面。在实际应用中,增强后的图像可能对检测效果并无益处,甚至会导致性能严重下降。在本文中,我们提出了一种基于目标引导的双对抗对比学习的水下增强方法,以实现视觉友好型和任务导向型的增强效果。具体而言,我们首先开发了一个双边约束闭环对抗增强模块,该模块以无监督方式放宽了对成对数据的要求,并通过与双逆映射相结合来保留更多信息特征。此外,为了使恢复后的图像具有更逼真的外观,我们在训练阶段还采用了对比线索。为了缩小视觉导向型和检测友好型目标图像之间的差距,在增强过程中嵌入了一个任务感知反馈模块,其中纳入了检测器的相干梯度信息,以引导增强朝着有利于检测的方向进行。为了验证性能,我们在我们的框架中配置了一系列丰富的检测器。大量实验表明,我们方法的增强结果在视觉质量上有显著改善,在我们增强后的图像上进行的不同检测器的准确性也得到了显著提高。此外,我们还进行了语义分割研究,以说明目标引导如何改善高级任务。代码和模型可在https://github.com/Jzy2017/TACL获取。

相似文献

1
Twin Adversarial Contrastive Learning for Underwater Image Enhancement and Beyond.用于水下图像增强及其他领域的孪生对抗对比学习
IEEE Trans Image Process. 2022;31:4922-4936. doi: 10.1109/TIP.2022.3190209. Epub 2022 Jul 22.
2
SGUIE-Net: Semantic Attention Guided Underwater Image Enhancement with Multi-Scale Perception.SGUIE-Net:基于多尺度感知的语义注意力引导水下图像增强
IEEE Trans Image Process. 2022 Oct 26;PP. doi: 10.1109/TIP.2022.3216208.
3
Image Enhancement Guided Object Detection in Visually Degraded Scenes.视觉退化场景中的图像增强引导目标检测
IEEE Trans Neural Netw Learn Syst. 2024 Oct;35(10):14164-14177. doi: 10.1109/TNNLS.2023.3274926. Epub 2024 Oct 7.
4
Cycle contrastive adversarial learning with structural consistency for unsupervised high-quality image deraining transformer.用于无监督高质量图像去雨的具有结构一致性的循环对比对抗学习变压器
Neural Netw. 2024 Oct;178:106428. doi: 10.1016/j.neunet.2024.106428. Epub 2024 Jun 4.
5
Domain Adaptation for Underwater Image Enhancement.水下图像增强的域适应
IEEE Trans Image Process. 2023;32:1442-1457. doi: 10.1109/TIP.2023.3244647. Epub 2023 Mar 1.
6
PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN With Dual-Discriminators.PUGAN:使用具有双判别器的生成对抗网络进行物理模型引导的水下图像增强
IEEE Trans Image Process. 2023;32:4472-4485. doi: 10.1109/TIP.2023.3286263. Epub 2023 Aug 8.
7
Towards a Flexible Semantic Guided Model for Single Image Enhancement and Restoration.迈向用于单图像增强与恢复的灵活语义引导模型。
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):9921-9939. doi: 10.1109/TPAMI.2024.3432308. Epub 2024 Nov 6.
8
An optimized GAN method based on the Que-Attn and contrastive learning for underwater image enhancement.基于 Que-Attn 和对比学习的水下图像增强优化 GAN 方法。
PLoS One. 2023 Jan 6;18(1):e0279945. doi: 10.1371/journal.pone.0279945. eCollection 2023.
9
Weakly-Supervised Contrastive Learning for Unsupervised Object Discovery.
IEEE Trans Image Process. 2024;33:2689-2702. doi: 10.1109/TIP.2024.3380243. Epub 2024 Apr 3.
10
U-Shape Transformer for Underwater Image Enhancement.U 型变换在水下图像增强中的应用。
IEEE Trans Image Process. 2023;32:3066-3079. doi: 10.1109/TIP.2023.3276332. Epub 2023 May 30.

引用本文的文献

1
Underwater image enhancement using hybrid transformers and evolutionary particle swarm optimization.基于混合变压器和进化粒子群优化的水下图像增强
Sci Rep. 2025 Aug 12;15(1):29575. doi: 10.1038/s41598-025-14439-5.
2
SEANet: Semantic Enhancement and Amplification for Underwater Object Detection in Complex Visual Scenarios.SEANet:复杂视觉场景下水下目标检测的语义增强与放大
Sensors (Basel). 2025 May 13;25(10):3078. doi: 10.3390/s25103078.
3
PCAFA-Net: A Physically Guided Network for Underwater Image Enhancement with Frequency-Spatial Attention.
PCAFA-Net:一种具有频率-空间注意力的水下图像增强物理引导网络。
Sensors (Basel). 2025 Mar 17;25(6):1861. doi: 10.3390/s25061861.
4
A generative adversarial network with multiscale and attention mechanisms for underwater image enhancement.一种具有多尺度和注意力机制的生成对抗网络用于水下图像增强。
Sci Rep. 2025 Jan 22;15(1):2787. doi: 10.1038/s41598-025-86949-1.
5
Addressing Once More the (Im)possibility of Color Reconstruction in Underwater Images.再次探讨水下图像颜色重建的(不)可能性
J Imaging. 2024 Oct 8;10(10):247. doi: 10.3390/jimaging10100247.
6
Underwater image enhancement using multi-task fusion.水下图像增强的多任务融合方法。
PLoS One. 2024 Feb 26;19(2):e0299110. doi: 10.1371/journal.pone.0299110. eCollection 2024.
7
Contrastive Transfer Learning for Prediction of Adverse Events in Hospitalized Patients.对比迁移学习在预测住院患者不良事件中的应用。
IEEE J Transl Eng Health Med. 2023 Dec 18;12:215-224. doi: 10.1109/JTEHM.2023.3344035. eCollection 2024.
8
Multi-Modality Image Fusion and Object Detection Based on Semantic Information.基于语义信息的多模态图像融合与目标检测
Entropy (Basel). 2023 Apr 26;25(5):718. doi: 10.3390/e25050718.
9
INAM-Based Image-Adaptive 3D LUTs for Underwater Image Enhancement.基于 INAM 的水下图像增强图像自适应 3D LUTs。
Sensors (Basel). 2023 Feb 15;23(4):2169. doi: 10.3390/s23042169.