• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于稀疏U型前馈网络的耀斑去除模型

Flare Removal Model Based on Sparse-UFormer Networks.

作者信息

Wu Siqi, Liu Fei, Bai Yu, Han Houzeng, Wang Jian, Zhang Ning

机构信息

School of Science, Beijing University of Civil Engineering and Architecture, Beijing 100044, China.

School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China.

出版信息

Entropy (Basel). 2024 Jul 25;26(8):627. doi: 10.3390/e26080627.

DOI:10.3390/e26080627
PMID:39202097
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11353522/
Abstract

When a camera lens is directly faced with a strong light source, image flare commonly occurs, significantly reducing the clarity and texture of the photo and interfering with image processing tasks that rely on visual sensors, such as image segmentation and feature extraction. A novel flare removal network, the Sparse-UFormer neural network, has been developed. The network integrates two core components onto the UFormer architecture: the mixed-scale feed-forward network (MSFN) and top-k sparse attention (TKSA), creating the sparse-transformer module. The MSFN module captures rich multi-scale information, enabling the more effective addressing of flare interference in images. The TKSA module, designed with a sparsity strategy, focuses on key features within the image, thereby significantly enhancing the precision and efficiency of flare removal. Furthermore, in the design of the loss function, besides the conventional flare, background, and reconstruction losses, a structural similarity index loss has been incorporated to ensure the preservation of image details and structure while removing the flare. Ensuring the minimal loss of image information is a fundamental premise for effective image restoration. The proposed method has been demonstrated to achieve state-of-the-art performance on the Flare7K++ test dataset and in challenging real-world scenarios, proving its effectiveness in removing flare artefacts from images.

摘要

当相机镜头直接面对强光源时,通常会出现图像光晕,这会显著降低照片的清晰度和质感,并干扰依赖视觉传感器的图像处理任务,如图像分割和特征提取。一种新型的光晕去除网络——稀疏UFormer神经网络已经被开发出来。该网络将两个核心组件集成到UFormer架构上:混合尺度前馈网络(MSFN)和top-k稀疏注意力(TKSA),创建了稀疏变压器模块。MSFN模块捕获丰富的多尺度信息,能够更有效地处理图像中的光晕干扰。TKSA模块采用稀疏策略设计,专注于图像中的关键特征,从而显著提高光晕去除的精度和效率。此外,在损失函数的设计中,除了传统的光晕、背景和重建损失外,还引入了结构相似性指数损失,以确保在去除光晕的同时保留图像细节和结构。确保图像信息损失最小是有效图像恢复的基本前提。所提出的方法已被证明在Flare7K++测试数据集和具有挑战性的真实场景中实现了领先的性能,证明了其在去除图像光晕伪影方面的有效性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/a7b96335fd68/entropy-26-00627-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/0195deaa0b84/entropy-26-00627-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/fed99d93174e/entropy-26-00627-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/6b24b07d88a7/entropy-26-00627-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/e281206627bc/entropy-26-00627-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/250ebf50eeec/entropy-26-00627-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/f1be47cbe338/entropy-26-00627-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/a2d183dd0116/entropy-26-00627-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/29f68fa56eb9/entropy-26-00627-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/ba1d616a3fb7/entropy-26-00627-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/a7b96335fd68/entropy-26-00627-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/0195deaa0b84/entropy-26-00627-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/fed99d93174e/entropy-26-00627-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/6b24b07d88a7/entropy-26-00627-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/e281206627bc/entropy-26-00627-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/250ebf50eeec/entropy-26-00627-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/f1be47cbe338/entropy-26-00627-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/a2d183dd0116/entropy-26-00627-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/29f68fa56eb9/entropy-26-00627-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/ba1d616a3fb7/entropy-26-00627-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/af37/11353522/a7b96335fd68/entropy-26-00627-g010.jpg

相似文献

1
Flare Removal Model Based on Sparse-UFormer Networks.基于稀疏U型前馈网络的耀斑去除模型
Entropy (Basel). 2024 Jul 25;26(8):627. doi: 10.3390/e26080627.
2
CGP-Uformer: A low-dose CT image denoising Uformer based on channel graph perception.CGP-Uformer:一种基于通道图感知的低剂量 CT 图像去噪 Uformer。
J Xray Sci Technol. 2023;31(6):1189-1205. doi: 10.3233/XST-230158.
3
Flare7K++: Mixing Synthetic and Real Datasets for Nighttime Flare Removal and Beyond.Flare7K++:混合合成数据集与真实数据集用于夜间耀斑去除及其他应用
IEEE Trans Pattern Anal Mach Intell. 2024 Nov;46(11):7041-7055. doi: 10.1109/TPAMI.2024.3406821. Epub 2024 Oct 3.
4
Low-light image enhancement using generative adversarial networks.使用生成对抗网络的低光照图像增强
Sci Rep. 2024 Aug 9;14(1):18489. doi: 10.1038/s41598-024-69505-1.
5
MS-TCNet: An effective Transformer-CNN combined network using multi-scale feature learning for 3D medical image segmentation.MS-TCNet:一种基于多尺度特征学习的有效的 Transformer-CNN 组合网络,用于 3D 医学图像分割。
Comput Biol Med. 2024 Mar;170:108057. doi: 10.1016/j.compbiomed.2024.108057. Epub 2024 Jan 28.
6
A dense and U-shaped transformer with dual-domain multi-loss function for sparse-view CT reconstruction.一种具有双域多损耗函数的密集 U 型变压器,用于稀疏视图 CT 重建。
J Xray Sci Technol. 2024;32(2):207-228. doi: 10.3233/XST-230184.
7
EMOST: A dual-branch hybrid network for medical image fusion via efficient model module and sparse transformer.EMOST:一种基于高效模型模块和稀疏 Transformer 的医学图像融合双分支混合网络。
Comput Biol Med. 2024 Sep;179:108771. doi: 10.1016/j.compbiomed.2024.108771. Epub 2024 Jul 5.
8
TLTNet: A novel transscale cascade layered transformer network for enhanced retinal blood vessel segmentation.TLTNet:一种新颖的跨尺度级联分层Transformer 网络,用于增强视网膜血管分割。
Comput Biol Med. 2024 Aug;178:108773. doi: 10.1016/j.compbiomed.2024.108773. Epub 2024 Jun 25.
9
Transformer guided self-adaptive network for multi-scale skin lesion image segmentation.Transformer 引导的自适网络用于多尺度皮肤病变图像分割。
Comput Biol Med. 2024 Feb;169:107846. doi: 10.1016/j.compbiomed.2023.107846. Epub 2023 Dec 23.
10
SwinCross: Cross-modal Swin transformer for head-and-neck tumor segmentation in PET/CT images.SwinCross:用于 PET/CT 图像中头颈部肿瘤分割的跨模态 Swin 变换器。
Med Phys. 2024 Mar;51(3):2096-2107. doi: 10.1002/mp.16703. Epub 2023 Sep 30.

本文引用的文献

1
Image De-Raining Transformer.图像去雨Transformer
IEEE Trans Pattern Anal Mach Intell. 2023 Nov;45(11):12978-12995. doi: 10.1109/TPAMI.2022.3183612. Epub 2023 Oct 3.
2
Region filling and object removal by exemplar-based image inpainting.基于样本的图像修复进行区域填充和目标去除
IEEE Trans Image Process. 2004 Sep;13(9):1200-12. doi: 10.1109/tip.2004.833105.
3
Removal of image intensifier veiling glare by mathematical deconvolution techniques.通过数学反卷积技术去除影像增强器的蒙片眩光。
Med Phys. 1985 May-Jun;12(3):281-8. doi: 10.1118/1.595720.