• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

融合优化网络:一种基于Transformer的压缩感知重建算法

FusionOpt-Net: A Transformer-Based Compressive Sensing Reconstruction Algorithm.

作者信息

Zhang Honghao, Chen Bi, Gao Xianwei, Yao Xiang, Hou Linyu

机构信息

Beijing Electronic Science and Technology Institute, Beijing 100070, China.

出版信息

Sensors (Basel). 2024 Sep 14;24(18):5976. doi: 10.3390/s24185976.

DOI:10.3390/s24185976
PMID:39338721
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11435510/
Abstract

Compressive sensing (CS) is a notable technique in signal processing, especially in multimedia, as it allows for simultaneous signal acquisition and dimensionality reduction. Recent advancements in deep learning (DL) have led to the creation of deep unfolding architectures, which overcome the inefficiency and subpar quality of traditional CS reconstruction methods. In this paper, we introduce a novel CS image reconstruction algorithm that leverages the strengths of the fast iterative shrinkage-thresholding algorithm (FISTA) and modern Transformer networks. To enhance computational efficiency, we employ a block-based sampling approach in the sampling module. By mapping FISTA's iterative process onto neural networks in the reconstruction module, we address the hyperparameter challenges of traditional algorithms, thereby improving reconstruction efficiency. Moreover, the robust feature extraction capabilities of Transformer networks significantly enhance image reconstruction quality. Experimental results show that the FusionOpt-Net model surpasses other advanced methods on various public benchmark datasets.

摘要

压缩感知(CS)是信号处理领域,尤其是多媒体领域的一项重要技术,因为它能够同时进行信号采集和降维。深度学习(DL)的最新进展催生了深度展开架构,克服了传统CS重建方法的低效率和质量欠佳问题。在本文中,我们介绍了一种新颖的CS图像重建算法,该算法利用了快速迭代收缩阈值算法(FISTA)和现代Transformer网络的优势。为提高计算效率,我们在采样模块中采用基于块的采样方法。通过在重建模块中将FISTA的迭代过程映射到神经网络上,我们解决了传统算法的超参数挑战,从而提高了重建效率。此外,Transformer网络强大的特征提取能力显著提升了图像重建质量。实验结果表明,FusionOpt-Net模型在各种公共基准数据集上优于其他先进方法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/0115b281b6b5/sensors-24-05976-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/945f6f2ca7c6/sensors-24-05976-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/1aef4e8d9256/sensors-24-05976-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/83abda52cab7/sensors-24-05976-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/2497b986252e/sensors-24-05976-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/0115b281b6b5/sensors-24-05976-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/945f6f2ca7c6/sensors-24-05976-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/1aef4e8d9256/sensors-24-05976-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/83abda52cab7/sensors-24-05976-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/2497b986252e/sensors-24-05976-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7635/11435510/0115b281b6b5/sensors-24-05976-g005.jpg

相似文献

1
FusionOpt-Net: A Transformer-Based Compressive Sensing Reconstruction Algorithm.融合优化网络:一种基于Transformer的压缩感知重建算法
Sensors (Basel). 2024 Sep 14;24(18):5976. doi: 10.3390/s24185976.
2
HFIST-Net: High-throughput fast iterative shrinkage thresholding network for accelerating MR image reconstruction.HFIST-Net:用于加速磁共振图像重建的高通量快速迭代收缩阈值网络。
Comput Methods Programs Biomed. 2023 Apr;232:107440. doi: 10.1016/j.cmpb.2023.107440. Epub 2023 Feb 24.
3
NesTD-Net: Deep NESTA-Inspired Unfolding Network With Dual-Path Deblocking Structure for Image Compressive Sensing.NesTD-Net:受NESTA启发的具有双路径去块结构的深度展开网络用于图像压缩感知
IEEE Trans Image Process. 2024;33:1923-1937. doi: 10.1109/TIP.2024.3371351. Epub 2024 Mar 14.
4
TransCS: A Transformer-Based Hybrid Architecture for Image Compressed Sensing.TransCS:一种基于Transformer的图像压缩感知混合架构。
IEEE Trans Image Process. 2022;31:6991-7005. doi: 10.1109/TIP.2022.3217365. Epub 2022 Nov 14.
5
SALSA-Net: Explainable Deep Unrolling Networks for Compressed Sensing.SALSA-Net:用于压缩感知的可解释深度展开网络。
Sensors (Basel). 2023 May 28;23(11):5142. doi: 10.3390/s23115142.
6
FISTA-NET: Deep Algorithm Unrolling for Cerenkov luminescence tomography.FISTA-NET:契伦科夫发光断层成像的深度算法展开。
Annu Int Conf IEEE Eng Med Biol Soc. 2023 Jul;2023:1-4. doi: 10.1109/EMBC40787.2023.10340506.
7
FISTA-Net: Learning a Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imaging.FISTA-Net:用于成像反问题的快速迭代收缩阈值网络学习
IEEE Trans Med Imaging. 2021 May;40(5):1329-1339. doi: 10.1109/TMI.2021.3054167. Epub 2021 Apr 30.
8
AMP-Net: Denoising-Based Deep Unfolding for Compressive Image Sensing.AMP-Net:基于去噪的深度展开压缩图像传感技术
IEEE Trans Image Process. 2021;30:1487-1500. doi: 10.1109/TIP.2020.3044472. Epub 2020 Dec 31.
9
Multi-Channel Representation Learning Enhanced Unfolding Multi-Scale Compressed Sensing Network for High Quality Image Reconstruction.用于高质量图像重建的多通道表示学习增强型展开多尺度压缩感知网络
Entropy (Basel). 2023 Nov 24;25(12):1579. doi: 10.3390/e25121579.
10
Iterative image reconstruction algorithm analysis for optical CT radiochromic gel dosimetry.迭代图像重建算法分析在光学 CT 放射性染色凝胶剂量测定中的应用。
Biomed Phys Eng Express. 2024 Apr 18;10(3). doi: 10.1088/2057-1976/ad3afe.

本文引用的文献

1
CSformer: Bridging Convolution and Transformer for Compressive Sensing.CSformer:用于压缩感知的桥接卷积和 Transformer。
IEEE Trans Image Process. 2023;32:2827-2842. doi: 10.1109/TIP.2023.3274988. Epub 2023 May 22.
2
TransCS: A Transformer-Based Hybrid Architecture for Image Compressed Sensing.TransCS:一种基于Transformer的图像压缩感知混合架构。
IEEE Trans Image Process. 2022;31:6991-7005. doi: 10.1109/TIP.2022.3217365. Epub 2022 Nov 14.
3
FISTA-Net: Learning a Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imaging.
FISTA-Net:用于成像反问题的快速迭代收缩阈值网络学习
IEEE Trans Med Imaging. 2021 May;40(5):1329-1339. doi: 10.1109/TMI.2021.3054167. Epub 2021 Apr 30.
4
AMP-Net: Denoising-Based Deep Unfolding for Compressive Image Sensing.AMP-Net:基于去噪的深度展开压缩图像传感技术
IEEE Trans Image Process. 2021;30:1487-1500. doi: 10.1109/TIP.2020.3044472. Epub 2020 Dec 31.
5
Image Compressed Sensing using Convolutional Neural Network.使用卷积神经网络的图像压缩感知
IEEE Trans Image Process. 2019 Jul 17. doi: 10.1109/TIP.2019.2928136.
6
ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing.ADMM-CSNet:一种用于图像压缩感知的深度学习方法。
IEEE Trans Pattern Anal Mach Intell. 2020 Mar;42(3):521-538. doi: 10.1109/TPAMI.2018.2883941. Epub 2018 Nov 28.
7
mScarlet: a bright monomeric red fluorescent protein for cellular imaging.mScarlet:一种明亮的单体红色荧光蛋白,用于细胞成像。
Nat Methods. 2017 Jan;14(1):53-56. doi: 10.1038/nmeth.4074. Epub 2016 Nov 21.
8
Compressive sensing in medical imaging.医学成像中的压缩感知
Appl Opt. 2015 Mar 10;54(8):C23-44. doi: 10.1364/AO.54.000C23.
9
Contour detection and hierarchical image segmentation.轮廓检测和层次图像分割。
IEEE Trans Pattern Anal Mach Intell. 2011 May;33(5):898-916. doi: 10.1109/TPAMI.2010.161.
10
Message-passing algorithms for compressed sensing.基于消息传递的压缩感知算法。
Proc Natl Acad Sci U S A. 2009 Nov 10;106(45):18914-9. doi: 10.1073/pnas.0909892106. Epub 2009 Oct 26.