• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于带偏置项和最大似然估计准则的神经网络的盲源分离方法。

Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion.

机构信息

College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China.

出版信息

Sensors (Basel). 2021 Feb 1;21(3):973. doi: 10.3390/s21030973.

DOI:10.3390/s21030973
PMID:33535650
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7867157/
Abstract

Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the perspective of neural networks (NNs) is a novel concept. In this paper, a blind source separation method, combining the maximum likelihood estimation criterion and an NN with a bias term, is proposed. The method adds L2 regularization terms for weights and biases to the loss function to improve the steady-state performance and designs a novel optimization algorithm with a dual acceleration strategy to improve the convergence speed of the algorithm. The dual acceleration strategy of the proposed optimization algorithm smooths and speeds up the originally steep, slow gradient descent in the parameter space. Compared with competing algorithms, this strategy improves the convergence speed of the algorithm by four times and the steady-state performance index by 96%. In addition, to verify the source separation performance of the algorithm more comprehensively, the simulation data with prior knowledge and the measured data without prior knowledge are used to verify the separation performance. Both simulation results and validation results based on measured data indicate that the new algorithm not only has better convergence and steady-state performance than conventional algorithms, but it is also more suitable for engineering applications.

摘要

收敛速度和稳态源分离性能对于盲源分离方法的工程应用至关重要。从神经网络(NN)的角度出发,修改盲源分离算法的损失函数并优化算法以提高其性能是一个新颖的概念。本文提出了一种盲源分离方法,将最大似然估计准则与具有偏差项的神经网络相结合。该方法在损失函数中添加了权重和偏差的 L2 正则化项,以提高稳态性能,并设计了一种具有双加速策略的新型优化算法,以提高算法的收敛速度。所提出的优化算法的双加速策略平滑并加快了参数空间中原本陡峭、缓慢的梯度下降。与竞争算法相比,该策略将算法的收敛速度提高了 4 倍,稳态性能指标提高了 96%。此外,为了更全面地验证算法的源分离性能,使用具有先验知识的仿真数据和无先验知识的实测数据验证分离性能。基于仿真数据和实测数据的验证结果均表明,新算法不仅比传统算法具有更好的收敛性和稳态性能,而且更适用于工程应用。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/83f18ebb5c72/sensors-21-00973-g023.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/49f4fdca737c/sensors-21-00973-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/3d5f9d239e09/sensors-21-00973-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/84ce5a555a20/sensors-21-00973-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/c02be452cc73/sensors-21-00973-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/d6536871a67c/sensors-21-00973-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/72ac56713587/sensors-21-00973-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/fac2ec498d2e/sensors-21-00973-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/0008e02d94fe/sensors-21-00973-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/212e14a82a5f/sensors-21-00973-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/fef5a2804000/sensors-21-00973-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/4f296703509c/sensors-21-00973-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/f3dedf241fe3/sensors-21-00973-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/5678669d6607/sensors-21-00973-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/d35f53f55754/sensors-21-00973-g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/e0aeb5910fd4/sensors-21-00973-g015.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/226741e9e3df/sensors-21-00973-g016.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/f873f2868dd7/sensors-21-00973-g017.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/d81ee800d1d7/sensors-21-00973-g018.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/a06292fc092b/sensors-21-00973-g019.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/cd3d51fb7c0b/sensors-21-00973-g020.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/07f849041122/sensors-21-00973-g021.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/2a7db527d77a/sensors-21-00973-g022.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/83f18ebb5c72/sensors-21-00973-g023.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/49f4fdca737c/sensors-21-00973-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/3d5f9d239e09/sensors-21-00973-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/84ce5a555a20/sensors-21-00973-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/c02be452cc73/sensors-21-00973-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/d6536871a67c/sensors-21-00973-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/72ac56713587/sensors-21-00973-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/fac2ec498d2e/sensors-21-00973-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/0008e02d94fe/sensors-21-00973-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/212e14a82a5f/sensors-21-00973-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/fef5a2804000/sensors-21-00973-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/4f296703509c/sensors-21-00973-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/f3dedf241fe3/sensors-21-00973-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/5678669d6607/sensors-21-00973-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/d35f53f55754/sensors-21-00973-g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/e0aeb5910fd4/sensors-21-00973-g015.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/226741e9e3df/sensors-21-00973-g016.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/f873f2868dd7/sensors-21-00973-g017.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/d81ee800d1d7/sensors-21-00973-g018.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/a06292fc092b/sensors-21-00973-g019.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/cd3d51fb7c0b/sensors-21-00973-g020.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/07f849041122/sensors-21-00973-g021.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/2a7db527d77a/sensors-21-00973-g022.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/daf9/7867157/83f18ebb5c72/sensors-21-00973-g023.jpg

相似文献

1
Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion.基于带偏置项和最大似然估计准则的神经网络的盲源分离方法。
Sensors (Basel). 2021 Feb 1;21(3):973. doi: 10.3390/s21030973.
2
Optimal Performance and Application for Seagull Optimization Algorithm Using a Hybrid Strategy.基于混合策略的海鸥优化算法的最优性能与应用
Entropy (Basel). 2022 Jul 14;24(7):973. doi: 10.3390/e24070973.
3
Adaptive improved natural gradient algorithm for blind source separation.用于盲源分离的自适应改进自然梯度算法
Neural Comput. 2009 Mar;21(3):872-89. doi: 10.1162/neco.2008.07-07-562.
4
A Blind Source Separation Method Based on Bounded Component Analysis Optimized by the Improved Beetle Antennae Search.一种基于改进甲虫触角搜索优化的有界分量分析的盲源分离方法
Sensors (Basel). 2023 Oct 8;23(19):8325. doi: 10.3390/s23198325.
5
An ordered-subsets proximal preconditioned gradient algorithm for edge-preserving PET image reconstruction.一种用于边缘保持 PET 图像重建的有序子集近端预条件梯度算法。
Med Phys. 2013 May;40(5):052503. doi: 10.1118/1.4801898.
6
An adaptive regularization parameter choice strategy for multispectral bioluminescence tomography.一种用于多光谱生物发光断层成像的自适应正则化参数选择策略。
Med Phys. 2011 Nov;38(11):5933-44. doi: 10.1118/1.3635221.
7
Blind Source Separation Based on Double-Mutant Butterfly Optimization Algorithm.基于双变异蝴蝶优化算法的盲源分离。
Sensors (Basel). 2022 May 24;22(11):3979. doi: 10.3390/s22113979.
8
Speed and convergence properties of gradient algorithms for optimization of IMRT.用于调强放射治疗优化的梯度算法的速度和收敛特性
Med Phys. 2004 May;31(5):1141-52. doi: 10.1118/1.1688214.
9
Neural Computing Enhanced Parameter Estimation for Multi-Input and Multi-Output Total Non-Linear Dynamic Models.用于多输入多输出完全非线性动态模型的神经计算增强参数估计
Entropy (Basel). 2020 Apr 30;22(5):510. doi: 10.3390/e22050510.
10
Heterogeneous multi-population competitive algorithm and its application in ASM1 parameter estimation.异构多群体竞争算法及其在ASM1参数估计中的应用。
Water Sci Technol. 2022 Nov;86(10):2495-2527. doi: 10.2166/wst.2022.356.

本文引用的文献

1
Deep learning in neural networks: an overview.神经网络中的深度学习:综述。
Neural Netw. 2015 Jan;61:85-117. doi: 10.1016/j.neunet.2014.09.003. Epub 2014 Oct 13.
2
Online blind source separation using incremental nonnegative matrix factorization with volume constraint.基于体积约束的增量非负矩阵分解的在线盲源分离
IEEE Trans Neural Netw. 2011 Apr;22(4):550-60. doi: 10.1109/TNN.2011.2109396. Epub 2011 Mar 3.
3
Analysis and online realization of the CCA approach for blind source separation.用于盲源分离的CCA方法的分析与在线实现
IEEE Trans Neural Netw. 2007 Sep;18(5):1505-10. doi: 10.1109/tnn.2007.894017.
4
Independent component analysis: algorithms and applications.独立成分分析:算法与应用
Neural Netw. 2000 May-Jun;13(4-5):411-30. doi: 10.1016/s0893-6080(00)00026-5.
5
High-order contrasts for independent component analysis.独立成分分析的高阶对比。
Neural Comput. 1999 Jan 1;11(1):157-92. doi: 10.1162/089976699300016863.
6
An information-maximization approach to blind separation and blind deconvolution.一种用于盲分离和盲反卷积的信息最大化方法。
Neural Comput. 1995 Nov;7(6):1129-59. doi: 10.1162/neco.1995.7.6.1129.