• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于棋盘变换器和卷积神经网络混合机制的图像去雨网络

Image rain removal network based on checkerboard transformer and CNN hybrid mechanism.

作者信息

Yang Yutian, Lin Jianyu, Dai Xinyue, Zhang Zhipei, Zhang Shuijin, Chen Yingyu, Kong Guangxin, Li Xin

机构信息

College of Computer Science and Technolog, Civil Aviation University of China, Tianjin, China.

University of Electronic Science and Technology of China, Zhongshan Institute, Zhongshan, China.

出版信息

PLoS One. 2025 May 16;20(5):e0322011. doi: 10.1371/journal.pone.0322011. eCollection 2025.

DOI:10.1371/journal.pone.0322011
PMID:40378370
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12084057/
Abstract

In this paper, a novel hybrid network called ChessFormer is proposed for the single image de-rain task. The network seamlessly integrates the advantages of Transformer and fitted neural network (CNN) in a checkerboard architecture, fully utilizing the global modeling capability of Transformer and the local feature extraction efficiency of CNN.ChessFormer adopts a multilevel feature extraction and progressive feature fusion strategy to efficiently achieve the rain line while preserving the We design a multidimensional transposed attention (MSTA), which enhances the network fusion for different rain patterns and mechanism image textures by combining self-attention with gated phase operation. In addition, the efficient architecture ensures full integration of features across dimensions and codecs. Experimental results show that ChessFormer outperforms existing methods in terms of quantitative metrics and visual quality on multiple benchmark datasets, achieving state-of-the-art performance with fewer parameters.

摘要

本文提出了一种名为ChessFormer的新型混合网络用于单图像去雨任务。该网络在棋盘架构中无缝集成了Transformer和卷积神经网络(CNN)的优势,充分利用了Transformer的全局建模能力和CNN的局部特征提取效率。ChessFormer采用多级特征提取和渐进式特征融合策略,在保留……的同时有效地实现雨线。我们设计了一种多维转置注意力(MSTA),通过将自注意力与门控相位操作相结合,增强了网络对不同雨型和机制图像纹理的融合。此外,高效的架构确保了跨维度和编解码器的特征完全集成。实验结果表明,ChessFormer在多个基准数据集上的定量指标和视觉质量方面优于现有方法,以更少的参数实现了当前最优性能。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/02f3d1a514e6/pone.0322011.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/cb7cb3ac32d0/pone.0322011.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/f1bbcfe98774/pone.0322011.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/297d0a7dd5a6/pone.0322011.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/bd1bd046f4b5/pone.0322011.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/02f3d1a514e6/pone.0322011.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/cb7cb3ac32d0/pone.0322011.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/f1bbcfe98774/pone.0322011.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/297d0a7dd5a6/pone.0322011.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/bd1bd046f4b5/pone.0322011.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1b65/12084057/02f3d1a514e6/pone.0322011.g005.jpg

相似文献

1
Image rain removal network based on checkerboard transformer and CNN hybrid mechanism.基于棋盘变换器和卷积神经网络混合机制的图像去雨网络
PLoS One. 2025 May 16;20(5):e0322011. doi: 10.1371/journal.pone.0322011. eCollection 2025.
2
Progressive Rain Removal Based on the Combination Network of CNN and Transformer.基于 CNN 和 Transformer 组合网络的递进式雨痕去除。
Comput Intell Neurosci. 2022 Sep 24;2022:5067175. doi: 10.1155/2022/5067175. eCollection 2022.
3
An enhanced denoising system for mammogram images using deep transformer model with fusion of local and global features.一种使用具有局部和全局特征融合的深度变压器模型的乳腺X光图像增强去噪系统。
Sci Rep. 2025 Feb 24;15(1):6562. doi: 10.1038/s41598-025-89451-w.
4
FDB-Net: Fusion double branch network combining CNN and transformer for medical image segmentation.FDB-Net:融合 CNN 和 Transformer 的双分支网络用于医学图像分割。
J Xray Sci Technol. 2024;32(4):931-951. doi: 10.3233/XST-230413.
5
EMOST: A dual-branch hybrid network for medical image fusion via efficient model module and sparse transformer.EMOST:一种基于高效模型模块和稀疏 Transformer 的医学图像融合双分支混合网络。
Comput Biol Med. 2024 Sep;179:108771. doi: 10.1016/j.compbiomed.2024.108771. Epub 2024 Jul 5.
6
HCformer: Hybrid CNN-Transformer for LDCT Image Denoising.HCformer:用于 LDCT 图像去噪的混合 CNN-Transformer。
J Digit Imaging. 2023 Oct;36(5):2290-2305. doi: 10.1007/s10278-023-00842-9. Epub 2023 Jun 29.
7
Magnetic resonance image denoising for Rician noise using a novel hybrid transformer-CNN network (HTC-net) and self-supervised pretraining.使用新型混合变压器-卷积神经网络(HTC-net)和自监督预训练对莱斯噪声进行磁共振图像去噪
Med Phys. 2025 Mar;52(3):1643-1660. doi: 10.1002/mp.17562. Epub 2024 Dec 6.
8
Enhanced Pneumonia Detection in Chest X-Rays Using Hybrid Convolutional and Vision Transformer Networks.使用混合卷积和视觉Transformer网络增强胸部X光片中的肺炎检测
Curr Med Imaging. 2025;21:e15734056326685. doi: 10.2174/0115734056326685250101113959.
9
HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion.HDCTfusion:基于卷积神经网络(CNN)和Transformer的混合双分支网络用于红外与可见光图像融合
Sensors (Basel). 2024 Dec 3;24(23):7729. doi: 10.3390/s24237729.
10
Image harmonization with Simple Hybrid CNN-Transformer Network.基于简单混合 CNN-Transformer 网络的图像调和。
Neural Netw. 2024 Dec;180:106673. doi: 10.1016/j.neunet.2024.106673. Epub 2024 Aug 30.

本文引用的文献

1
An Efficient Single Image De-Raining Model With Decoupled Deep Networks.一种基于解耦深度网络的高效单图像去雨模型。
IEEE Trans Image Process. 2024;33:69-81. doi: 10.1109/TIP.2023.3335822. Epub 2023 Dec 8.
2
Conformer: Local Features Coupling Global Representations for Recognition and Detection.构象:用于识别和检测的局部特征与全局表示相结合。
IEEE Trans Pattern Anal Mach Intell. 2023 Aug;45(8):9454-9468. doi: 10.1109/TPAMI.2023.3243048. Epub 2023 Jun 30.
3
Multi-Scale Hybrid Fusion Network for Single Image Deraining.用于单图像去雨的多尺度混合融合网络
IEEE Trans Neural Netw Learn Syst. 2023 Jul;34(7):3594-3608. doi: 10.1109/TNNLS.2021.3112235. Epub 2023 Jul 6.
4
ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning.ProtTrans:通过自监督学习理解生命语言。
IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):7112-7127. doi: 10.1109/TPAMI.2021.3095381. Epub 2022 Sep 14.
5
CCNet: Criss-Cross Attention for Semantic Segmentation.CCNet:用于语义分割的交叉注意力。
IEEE Trans Pattern Anal Mach Intell. 2023 Jun;45(6):6896-6908. doi: 10.1109/TPAMI.2020.3007032. Epub 2023 May 5.
6
Lightweight Pyramid Networks for Image Deraining.用于图像去雨的轻量级金字塔网络。
IEEE Trans Neural Netw Learn Syst. 2020 Jun;31(6):1794-1807. doi: 10.1109/TNNLS.2019.2926481. Epub 2019 Jul 22.
7
Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks.利用上下文感知深度网络从单幅图像中联合检测和去除雨滴
IEEE Trans Pattern Anal Mach Intell. 2020 Jun;42(6):1377-1393. doi: 10.1109/TPAMI.2019.2895793. Epub 2019 Jan 28.
8
Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal.清除天空:一种用于单图像去雨的深度网络架构。
IEEE Trans Image Process. 2017 Jun;26(6):2944-2956. doi: 10.1109/TIP.2017.2691802. Epub 2017 Apr 6.
9
Fully Convolutional Networks for Semantic Segmentation.全卷积网络用于语义分割。
IEEE Trans Pattern Anal Mach Intell. 2017 Apr;39(4):640-651. doi: 10.1109/TPAMI.2016.2572683. Epub 2016 May 24.