• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

逆问题的正则化、贝叶斯推理及机器学习方法

Regularization, Bayesian Inference, and Machine Learning Methods for Inverse Problems.

作者信息

Mohammad-Djafari Ali

机构信息

Laboratoire des Signaux et Système, CNRS, CentraleSupélec-University Paris Saclay, 91192 Gif-sur-Yvette, France.

International Science Consulting and Training (ISCT), 91440 Bures-sur-Yvette, France.

出版信息

Entropy (Basel). 2021 Dec 13;23(12):1673. doi: 10.3390/e23121673.

DOI:10.3390/e23121673
PMID:34945979
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC8699938/
Abstract

Classical methods for inverse problems are mainly based on regularization theory, in particular those, that are based on optimization of a criterion with two parts: a data-model matching and a regularization term. Different choices for these two terms and a great number of optimization algorithms have been proposed. When these two terms are distance or divergence measures, they can have a Bayesian Maximum A Posteriori (MAP) interpretation where these two terms correspond to the likelihood and prior-probability models, respectively. The Bayesian approach gives more flexibility in choosing these terms and, in particular, the prior term via hierarchical models and hidden variables. However, the Bayesian computations can become very heavy computationally. The machine learning (ML) methods such as classification, clustering, segmentation, and regression, based on neural networks (NN) and particularly convolutional NN, deep NN, physics-informed neural networks, etc. can become helpful to obtain approximate practical solutions to inverse problems. In this tutorial article, particular examples of image denoising, image restoration, and computed-tomography (CT) image reconstruction will illustrate this cooperation between ML and inversion.

摘要

经典的反问题方法主要基于正则化理论,特别是那些基于对包含两部分的准则进行优化的方法:数据-模型匹配项和正则化项。针对这两项已经提出了不同的选择以及大量的优化算法。当这两项是距离或散度度量时,它们可以有贝叶斯最大后验(MAP)解释,其中这两项分别对应于似然模型和先验概率模型。贝叶斯方法在选择这些项时,特别是通过层次模型和隐藏变量选择先验项时,具有更大的灵活性。然而,贝叶斯计算在计算上可能会变得非常繁重。基于神经网络(NN),特别是卷积神经网络、深度神经网络、物理信息神经网络等的机器学习(ML)方法,如分类、聚类、分割和回归,可能有助于获得反问题的近似实际解决方案。在本教程文章中,图像去噪、图像恢复和计算机断层扫描(CT)图像重建的具体示例将说明ML与反演之间的这种协作。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/c7beef1ae567/entropy-23-01673-g025.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/7be0497a5736/entropy-23-01673-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/dc174bdcd752/entropy-23-01673-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/3034e3d71eec/entropy-23-01673-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/8993f77f9f44/entropy-23-01673-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2bcd225d8cbf/entropy-23-01673-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/b712c99e9590/entropy-23-01673-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2bdd713bb66b/entropy-23-01673-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/e47d87b60704/entropy-23-01673-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/0e364626f766/entropy-23-01673-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/7ecd3dc6ad2a/entropy-23-01673-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/fb83128c73ec/entropy-23-01673-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/a0ca84a9d42a/entropy-23-01673-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/10be833ce449/entropy-23-01673-g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2129b3523691/entropy-23-01673-g015.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/d82f9226895b/entropy-23-01673-g016.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/5f76238cdfac/entropy-23-01673-g017.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/03f161679875/entropy-23-01673-g018.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/5f6893065785/entropy-23-01673-g019.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/4470160d76e2/entropy-23-01673-g020.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2167122e52de/entropy-23-01673-g021.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/d3097367dfad/entropy-23-01673-g022.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/6ee323827896/entropy-23-01673-g023.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/cb0b376dcd7c/entropy-23-01673-g024.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/c7beef1ae567/entropy-23-01673-g025.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/7be0497a5736/entropy-23-01673-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/dc174bdcd752/entropy-23-01673-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/3034e3d71eec/entropy-23-01673-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/8993f77f9f44/entropy-23-01673-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2bcd225d8cbf/entropy-23-01673-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/b712c99e9590/entropy-23-01673-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2bdd713bb66b/entropy-23-01673-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/e47d87b60704/entropy-23-01673-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/0e364626f766/entropy-23-01673-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/7ecd3dc6ad2a/entropy-23-01673-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/fb83128c73ec/entropy-23-01673-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/a0ca84a9d42a/entropy-23-01673-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/10be833ce449/entropy-23-01673-g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2129b3523691/entropy-23-01673-g015.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/d82f9226895b/entropy-23-01673-g016.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/5f76238cdfac/entropy-23-01673-g017.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/03f161679875/entropy-23-01673-g018.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/5f6893065785/entropy-23-01673-g019.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/4470160d76e2/entropy-23-01673-g020.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/2167122e52de/entropy-23-01673-g021.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/d3097367dfad/entropy-23-01673-g022.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/6ee323827896/entropy-23-01673-g023.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/cb0b376dcd7c/entropy-23-01673-g024.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ccd9/8699938/c7beef1ae567/entropy-23-01673-g025.jpg

相似文献

1
Regularization, Bayesian Inference, and Machine Learning Methods for Inverse Problems.逆问题的正则化、贝叶斯推理及机器学习方法
Entropy (Basel). 2021 Dec 13;23(12):1673. doi: 10.3390/e23121673.
2
Remaining Useful Life Prediction of Lithium-Ion Batteries Using Neural Networks with Adaptive Bayesian Learning.基于自适应贝叶斯学习的神经网络的锂离子电池剩余使用寿命预测。
Sensors (Basel). 2022 May 17;22(10):3803. doi: 10.3390/s22103803.
3
Joint NDT image restoration and segmentation using Gauss-Markov-Potts prior models and variational Bayesian computation.基于高斯-马尔可夫-泊松先验模型和变分贝叶斯计算的联合无损检测图像恢复和分割。
IEEE Trans Image Process. 2010 Sep;19(9):2265-77. doi: 10.1109/TIP.2010.2047902. Epub 2010 Apr 8.
4
Posterior temperature optimized Bayesian models for inverse problems in medical imaging.用于医学成像反问题的后验温度优化贝叶斯模型。
Med Image Anal. 2022 May;78:102382. doi: 10.1016/j.media.2022.102382. Epub 2022 Feb 11.
5
Constrained and unconstrained deep image prior optimization models with automatic regularization.具有自动正则化的约束和无约束深度图像先验优化模型。
Comput Optim Appl. 2023;84(1):125-149. doi: 10.1007/s10589-022-00392-w. Epub 2022 Jul 27.
6
Kernelized Sparse Bayesian Matrix Factorization.核化稀疏贝叶斯矩阵分解
IEEE Trans Neural Netw Learn Syst. 2021 Jan;32(1):391-404. doi: 10.1109/TNNLS.2020.2978761. Epub 2021 Jan 4.
7
A segmentation-based regularization term for image deconvolution.一种用于图像去卷积的基于分割的正则化项。
IEEE Trans Image Process. 2006 Jul;15(7):1973-84. doi: 10.1109/tip.2006.873446.
8
ML and MAP estimation of parameters for the Kalman filter and smoother applied to electrocardiographic imaging.卡尔曼滤波器和平滑器参数的 ML 和 MAP 估计及其在心电图成像中的应用。
Med Biol Eng Comput. 2019 Oct;57(10):2093-2113. doi: 10.1007/s11517-019-02018-6. Epub 2019 Jul 30.
9
A neural network with encoded visible edge prior for limited-angle computed tomography reconstruction.基于编码可见边缘先验的神经网络用于有限角度计算机断层扫描重建。
Med Phys. 2021 Oct;48(10):6464-6481. doi: 10.1002/mp.15205. Epub 2021 Sep 18.
10
Measuring the Uncertainty of Predictions in Deep Neural Networks with Variational Inference.用变分推断测量深度神经网络的预测不确定性。
Sensors (Basel). 2020 Oct 23;20(21):6011. doi: 10.3390/s20216011.

引用本文的文献

1
The Second Law of Infodynamics: A Thermocontextual Reformulation.信息动力学第二定律:一种热语境重构。
Entropy (Basel). 2024 Dec 30;27(1):22. doi: 10.3390/e27010022.
2
Probabilistic nested model selection in pharmacokinetic analysis of DCE-MRI data in animal model of cerebral tumor.脑肿瘤动物模型中DCE-MRI数据药代动力学分析的概率嵌套模型选择
Sci Rep. 2025 Jan 13;15(1):1786. doi: 10.1038/s41598-024-83306-6.
3
Probabilistic Nested Model Selection in Pharmacokinetic Analysis of DCE-MRI Data in Animal Model of Cerebral Tumor.

本文引用的文献

1
A High-Efficient Hybrid Physics-Informed Neural Networks Based on Convolutional Neural Network.一种基于卷积神经网络的高效混合物理信息神经网络。
IEEE Trans Neural Netw Learn Syst. 2022 Oct;33(10):5514-5526. doi: 10.1109/TNNLS.2021.3070878. Epub 2022 Oct 5.
2
Momentum-Net: Fast and Convergent Iterative Neural Network for Inverse Problems.动量网络:用于反问题的快速收敛迭代神经网络。
IEEE Trans Pattern Anal Mach Intell. 2023 Apr;45(4):4915-4931. doi: 10.1109/TPAMI.2020.3012955. Epub 2023 Mar 10.
3
Learning Deep Gradient Descent Optimization for Image Deconvolution.
脑肿瘤动物模型中DCE-MRI数据药代动力学分析的概率嵌套模型选择
Res Sq. 2024 Jun 12:rs.3.rs-4469232. doi: 10.21203/rs.3.rs-4469232/v1.
4
Dynamic contrast enhanced (DCE) MRI estimation of vascular parameters using knowledge-based adaptive models.基于知识的自适应模型的动态对比增强(DCE)MRI 血管参数估计。
Sci Rep. 2023 Jun 14;13(1):9672. doi: 10.1038/s41598-023-36483-9.
5
Machine-Learning-Based Data Analysis Method for Cell-Based Selection of DNA-Encoded Libraries.基于机器学习的用于基于细胞筛选DNA编码文库的数据分析方法
ACS Omega. 2023 May 15;8(21):19057-19071. doi: 10.1021/acsomega.3c02152. eCollection 2023 May 30.
6
Quantitative assessment method of muzzle flash and smoke at high noise level on field environment.野外环境下高噪声级枪口焰和烟雾的定量评估方法。
Sci Rep. 2023 Jan 27;13(1):1480. doi: 10.1038/s41598-023-27722-0.
7
Programmable Density of Laser Additive Manufactured Parts by Considering an Inverse Problem.通过考虑一个反问题来实现激光增材制造零件的可编程密度
Materials (Basel). 2022 Oct 12;15(20):7090. doi: 10.3390/ma15207090.
8
Computational Methods for Parameter Identification in 2D Fractional System with Riemann-Liouville Derivative.二维分数阶系统中具有 Riemann-Liouville 导数的参数辨识的计算方法。
Sensors (Basel). 2022 Apr 20;22(9):3153. doi: 10.3390/s22093153.
学习用于图像反卷积的深度梯度下降优化方法。
IEEE Trans Neural Netw Learn Syst. 2020 Dec;31(12):5468-5482. doi: 10.1109/TNNLS.2020.2968289. Epub 2020 Nov 30.
4
DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction.DAGAN:用于快速压缩感知 MRI 重建的深度去混淆生成对抗网络。
IEEE Trans Med Imaging. 2018 Jun;37(6):1310-1321. doi: 10.1109/TMI.2017.2785879.
5
Enhanced gradient for training restricted Boltzmann machines.增强型梯度用于训练受限玻尔兹曼机。
Neural Comput. 2013 Mar;25(3):805-31. doi: 10.1162/NECO_a_00397. Epub 2012 Nov 13.
6
Joint NDT image restoration and segmentation using Gauss-Markov-Potts prior models and variational Bayesian computation.基于高斯-马尔可夫-泊松先验模型和变分贝叶斯计算的联合无损检测图像恢复和分割。
IEEE Trans Image Process. 2010 Sep;19(9):2265-77. doi: 10.1109/TIP.2010.2047902. Epub 2010 Apr 8.
7
Total variation blind deconvolution.全变差盲反卷积
IEEE Trans Image Process. 1998;7(3):370-5. doi: 10.1109/83.661187.
8
Selection of a convolution function for Fourier inversion using gridding [computerised tomography application].选择卷积函数进行傅里叶反演的网格化方法 [计算机层析成像应用]。
IEEE Trans Med Imaging. 1991;10(3):473-8. doi: 10.1109/42.97598.