• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于学习注意力正则化的迭代优化图像重建

Iteratively Refined Image Reconstruction with Learned Attentive Regularizers.

作者信息

Pourya Mehrsa, Neumayer Sebastian, Unser Michael

机构信息

Biomedical Imaging Group, EPFL, Lausanne, Switzerland.

Professorship of Inverse Problems, TU Chemnitz, Chemnitz, Germany.

出版信息

Numer Funct Anal Optim. 2024 Aug 11;45(7-9):411-440. doi: 10.1080/01630563.2024.2384849. eCollection 2024.

DOI:10.1080/01630563.2024.2384849
PMID:39233889
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11371266/
Abstract

We propose a regularization scheme for image reconstruction that leverages the power of deep learning while hinging on classic sparsity-promoting models. Many deep-learning-based models are hard to interpret and cumbersome to analyze theoretically. In contrast, our scheme is interpretable because it corresponds to the minimization of a series of convex problems. For each problem in the series, a mask is generated based on the previous solution to refine the regularization strength spatially. In this way, the model becomes progressively attentive to the image structure. For the underlying update operator, we prove the existence of a fixed point. As a special case, we investigate a mask generator for which the fixed-point iterations converge to a critical point of an explicit energy functional. In our experiments, we match the performance of state-of-the-art learned variational models for the solution of inverse problems. Additionally, we offer a promising balance between interpretability, theoretical guarantees, reliability, and performance.

摘要

我们提出了一种用于图像重建的正则化方案,该方案利用深度学习的力量,同时依赖于经典的稀疏性促进模型。许多基于深度学习的模型难以解释,并且在理论分析上很繁琐。相比之下,我们的方案是可解释的,因为它对应于一系列凸问题的最小化。对于该系列中的每个问题,基于先前的解生成一个掩码,以便在空间上细化正则化强度。通过这种方式,模型逐渐关注图像结构。对于底层的更新算子,我们证明了不动点的存在性。作为一个特殊情况,我们研究了一种掩码生成器,其不动点迭代收敛到一个显式能量泛函的临界点。在我们的实验中,我们在求解逆问题时达到了与最先进的学习变分模型相当的性能。此外,我们在可解释性、理论保证、可靠性和性能之间提供了一种有前景的平衡。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/d4d875f89100/LNFA_A_2384849_F0008_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/dc56d25f84ef/LNFA_A_2384849_F0001_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/a90b7414cd80/LNFA_A_2384849_F0002_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/19a20fa62b2e/LNFA_A_2384849_F0003_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/f004b0e984b3/LNFA_A_2384849_F0004_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/026419c38dcb/LNFA_A_2384849_F0005_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/7bec474901e3/LNFA_A_2384849_F0006_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/5990890af9c9/LNFA_A_2384849_F0007_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/d4d875f89100/LNFA_A_2384849_F0008_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/dc56d25f84ef/LNFA_A_2384849_F0001_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/a90b7414cd80/LNFA_A_2384849_F0002_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/19a20fa62b2e/LNFA_A_2384849_F0003_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/f004b0e984b3/LNFA_A_2384849_F0004_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/026419c38dcb/LNFA_A_2384849_F0005_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/7bec474901e3/LNFA_A_2384849_F0006_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/5990890af9c9/LNFA_A_2384849_F0007_B.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2b38/11371266/d4d875f89100/LNFA_A_2384849_F0008_B.jpg

相似文献

1
Iteratively Refined Image Reconstruction with Learned Attentive Regularizers.基于学习注意力正则化的迭代优化图像重建
Numer Funct Anal Optim. 2024 Aug 11;45(7-9):411-440. doi: 10.1080/01630563.2024.2384849. eCollection 2024.
2
Deep supervised dictionary learning by algorithm unrolling-Application to fast 2D dynamic MR image reconstruction.基于算法展开的深度监督字典学习——在快速二维动态磁共振图像重建中的应用
Med Phys. 2023 May;50(5):2939-2960. doi: 10.1002/mp.16182. Epub 2023 Jan 17.
3
VAEs with structured image covariance applied to compressed sensing MRI.应用于压缩感知 MRI 的具有结构图像协方差的变分自编码器。
Phys Med Biol. 2023 Aug 3;68(16). doi: 10.1088/1361-6560/ace49a.
4
Plug-and-Play Regularization Using Linear Solvers.使用线性求解器的即插即用正则化
IEEE Trans Image Process. 2022;31:6344-6355. doi: 10.1109/TIP.2022.3211473. Epub 2022 Oct 14.
5
Super-resolution image reconstruction from sparsity regularization and deep residual-learned priors.基于稀疏正则化和深度残差学习先验的超分辨率图像重建
J Xray Sci Technol. 2023;31(2):319-336. doi: 10.3233/XST-221299.
6
Hessian-based norm regularization for image restoration with biomedical applications.基于 Hessian 的范数正则化在生物医学图像恢复中的应用。
IEEE Trans Image Process. 2012 Mar;21(3):983-95. doi: 10.1109/TIP.2011.2168232. Epub 2011 Sep 19.
7
SpiNet: A deep neural network for Schatten p-norm regularized medical image reconstruction.SpiNet:用于 Schatten p-范数正则化医学图像重建的深度神经网络。
Med Phys. 2021 May;48(5):2214-2229. doi: 10.1002/mp.14744. Epub 2021 Mar 22.
8
Discretization of Learned NETT Regularization for Solving Inverse Problems.用于求解逆问题的学习到的NETT正则化的离散化
J Imaging. 2021 Nov 15;7(11):239. doi: 10.3390/jimaging7110239.
9
Variational based Mixed Noise Removal with CNN Deep Learning Regularization.基于变分法并结合卷积神经网络深度学习正则化的混合噪声去除方法
IEEE Trans Image Process. 2019 Sep 25. doi: 10.1109/TIP.2019.2940496.
10
Optimization Induced Equilibrium Networks: An Explicit Optimization Perspective for Understanding Equilibrium Models.优化诱导平衡网络:一种理解平衡模型的显式优化视角
IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):3604-3616. doi: 10.1109/TPAMI.2022.3181425. Epub 2023 Feb 3.

本文引用的文献

1
On instabilities of deep learning in image reconstruction and the potential costs of AI.深度学习在图像重建中的不稳定性及人工智能的潜在代价
Proc Natl Acad Sci U S A. 2020 Dec 1;117(48):30088-30095. doi: 10.1073/pnas.1907377117. Epub 2020 May 11.
2
fastMRI: A Publicly Available Raw k-Space and DICOM Dataset of Knee Images for Accelerated MR Image Reconstruction Using Machine Learning.快速磁共振成像(fastMRI):一个公开可用的膝关节图像原始k空间和DICOM数据集,用于使用机器学习加速磁共振图像重建。
Radiol Artif Intell. 2020 Jan 29;2(1):e190007. doi: 10.1148/ryai.2020190007.
3
ESPIRiT--an eigenvalue approach to autocalibrating parallel MRI: where SENSE meets GRAPPA.
ESPIRiT——一种用于自动校准并行MRI的特征值方法:SENSE与GRAPPA的结合。
Magn Reson Med. 2014 Mar;71(3):990-1001. doi: 10.1002/mrm.24751.
4
Hessian-based norm regularization for image restoration with biomedical applications.基于 Hessian 的范数正则化在生物医学图像恢复中的应用。
IEEE Trans Image Process. 2012 Mar;21(3):983-95. doi: 10.1109/TIP.2011.2168232. Epub 2011 Sep 19.
5
Contour detection and hierarchical image segmentation.轮廓检测和层次图像分割。
IEEE Trans Pattern Anal Mach Intell. 2011 May;33(5):898-916. doi: 10.1109/TPAMI.2010.161.
6
Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems.用于约束全变差图像去噪和去模糊问题的基于快速梯度的算法。
IEEE Trans Image Process. 2009 Nov;18(11):2419-34. doi: 10.1109/TIP.2009.2028250. Epub 2009 Jul 24.
7
Majorization-minimization algorithms for wavelet-based image restoration.基于小波的图像恢复的优化最小化算法。
IEEE Trans Image Process. 2007 Dec;16(12):2980-91. doi: 10.1109/tip.2007.909318.
8
An expanded theoretical treatment of iteration-dependent majorize-minimize algorithms.关于迭代相关的主元最小化算法的扩展理论处理。
IEEE Trans Image Process. 2007 Oct;16(10):2411-22. doi: 10.1109/tip.2007.904387.
9
Image denoising by sparse 3-D transform-domain collaborative filtering.基于稀疏三维变换域协同滤波的图像去噪
IEEE Trans Image Process. 2007 Aug;16(8):2080-95. doi: 10.1109/tip.2007.901238.