• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

复杂过程中信息产生与广义熵的等价性。

Equivalence of information production and generalised entropies in complex processes.

机构信息

Section for Science of Complex Systems, CeMDS, Medical University of Vienna, Vienna, Austria.

Complexity Science Hub Vienna, Vienna, Austria.

出版信息

PLoS One. 2023 Sep 6;18(9):e0290695. doi: 10.1371/journal.pone.0290695. eCollection 2023.

DOI:10.1371/journal.pone.0290695
PMID:37672525
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10482297/
Abstract

Complex systems with strong correlations and fat-tailed distribution functions have been argued to be incompatible with the Boltzmann-Gibbs entropy framework and alternatives, so-called generalised entropies, were proposed and studied. Here we show, that this perceived incompatibility is actually a misconception. For a broad class of processes, Boltzmann entropy -the log multiplicity- remains the valid entropy concept. However, for non-i.i.d. processes, Boltzmann entropy is not of Shannon form, -k∑ipi log pi, but takes the shape of generalised entropies. We derive this result for all processes that can be asymptotically mapped to adjoint representations reversibly where processes are i.i.d. In these representations the information production is given by the Shannon entropy. Over the original sampling space this yields functionals identical to generalised entropies. The problem of constructing adequate context-sensitive entropy functionals therefore can be translated into the much simpler problem of finding adjoint representations. The method provides a comprehensive framework for a statistical physics of strongly correlated systems and complex processes.

摘要

具有强相关性和长尾分布函数的复杂系统被认为与玻尔兹曼-吉布斯熵框架和替代的所谓广义熵不兼容,因此提出并研究了这些替代的广义熵。在这里,我们表明,这种被认为的不兼容性实际上是一种误解。对于广泛的一类过程,玻尔兹曼熵——对数多重性——仍然是有效的熵概念。然而,对于非独立同分布过程,玻尔兹曼熵不是香农形式的-k∑ipi log pi,而是广义熵的形式。我们推导出所有可以渐近地可逆映射到伴随表示的过程的这个结果,其中过程是独立同分布的。在这些表示中,信息产生由香农熵给出。在原始采样空间上,这产生与广义熵相同的泛函。因此,构建适当的上下文敏感熵泛函的问题可以转化为寻找伴随表示的简单得多的问题。该方法为强相关性系统和复杂过程的统计物理提供了一个全面的框架。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b8db/10482297/59787e301a06/pone.0290695.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b8db/10482297/59787e301a06/pone.0290695.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b8db/10482297/59787e301a06/pone.0290695.g001.jpg

相似文献

1
Equivalence of information production and generalised entropies in complex processes.复杂过程中信息产生与广义熵的等价性。
PLoS One. 2023 Sep 6;18(9):e0290695. doi: 10.1371/journal.pone.0290695. eCollection 2023.
2
How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.多元性如何决定熵以及复杂系统最大熵原理的推导。
Proc Natl Acad Sci U S A. 2014 May 13;111(19):6905-10. doi: 10.1073/pnas.1406071111. Epub 2014 Apr 29.
3
Group Entropies: From Phase Space Geometry to Entropy Functionals via Group Theory.群熵:从相空间几何经由群论到熵泛函
Entropy (Basel). 2018 Oct 19;20(10):804. doi: 10.3390/e20100804.
4
Beyond Boltzmann-Gibbs-Shannon in Physics and Elsewhere.超越物理学及其他领域中的玻尔兹曼-吉布斯-香农理论
Entropy (Basel). 2019 Jul 15;21(7):696. doi: 10.3390/e21070696.
5
Applications of Entropy in Data Analysis and Machine Learning: A Review.熵在数据分析与机器学习中的应用:综述
Entropy (Basel). 2024 Dec 23;26(12):1126. doi: 10.3390/e26121126.
6
Generalized entropies and logarithms and their duality relations.广义熵和对数及其对偶关系。
Proc Natl Acad Sci U S A. 2012 Nov 20;109(47):19151-4. doi: 10.1073/pnas.1216885109. Epub 2012 Nov 5.
7
Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle.复杂系统的熵的三个方面:信息、热力学和最大熵原理。
Phys Rev E. 2017 Sep;96(3-1):032124. doi: 10.1103/PhysRevE.96.032124. Epub 2017 Sep 15.
8
Maximum Configuration Principle for Driven Systems with Arbitrary Driving.具有任意驱动的驱动系统的最大配置原理
Entropy (Basel). 2018 Nov 1;20(11):838. doi: 10.3390/e20110838.
9
Distinguishing between Clausius, Boltzmann and Pauling Entropies of Frozen Non-Equilibrium States.区分冻结非平衡态的克劳修斯熵、玻尔兹曼熵和鲍林熵。
Entropy (Basel). 2019 Aug 15;21(8):799. doi: 10.3390/e21080799.
10
Group entropies, correlation laws, and zeta functions.群熵、相关定律和黎曼ζ函数。
Phys Rev E Stat Nonlin Soft Matter Phys. 2011 Aug;84(2 Pt 1):021121. doi: 10.1103/PhysRevE.84.021121. Epub 2011 Aug 10.

本文引用的文献

1
Thermodynamics of structure-forming systems.结构形成系统的热力学
Nat Commun. 2021 Feb 18;12(1):1127. doi: 10.1038/s41467-021-21272-7.
2
Maximum Configuration Principle for Driven Systems with Arbitrary Driving.具有任意驱动的驱动系统的最大配置原理
Entropy (Basel). 2018 Nov 1;20(11):838. doi: 10.3390/e20110838.
3
The generalized Boltzmann distribution is the only distribution in which the Gibbs-Shannon entropy equals the thermodynamic entropy.广义玻尔兹曼分布是吉布斯 - 香农熵等于热力学熵的唯一分布。
J Chem Phys. 2019 Jul 21;151(3):034113. doi: 10.1063/1.5111333.
4
How Far can Neural Correlations Reduce Uncertainty? Comparison of Information Transmission Rates for Markov and Bernoulli Processes.神经相关能在多大程度上降低不确定性?马尔可夫和伯努利过程的信息传递率比较。
Int J Neural Syst. 2019 Oct;29(8):1950003. doi: 10.1142/S0129065719500035. Epub 2019 Jan 14.
5
Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle.复杂系统的熵的三个方面:信息、热力学和最大熵原理。
Phys Rev E. 2017 Sep;96(3-1):032124. doi: 10.1103/PhysRevE.96.032124. Epub 2017 Sep 15.
6
Understanding scaling through history-dependent processes with collapsing sample space.通过具有坍缩样本空间的历史依赖过程理解标度。
Proc Natl Acad Sci U S A. 2015 Apr 28;112(17):5348-53. doi: 10.1073/pnas.1420946112. Epub 2015 Apr 13.
7
Advances in the generalized entropy theory of glass-formation in polymer melts.聚合物熔体中玻璃形成的广义熵理论进展。
J Chem Phys. 2014 Dec 21;141(23):234903. doi: 10.1063/1.4903842.
8
How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.多元性如何决定熵以及复杂系统最大熵原理的推导。
Proc Natl Acad Sci U S A. 2014 May 13;111(19):6905-10. doi: 10.1073/pnas.1406071111. Epub 2014 Apr 29.
9
The entropy concept for non-equilibrium states.非平衡态的熵概念。
Proc Math Phys Eng Sci. 2013 Oct 8;469(2158):20130408. doi: 10.1098/rspa.2013.0408.
10
Asymptotically scale-invariant occupancy of phase space makes the entropy Sq extensive.相空间的渐近尺度不变占据使熵Sq具有广延性。
Proc Natl Acad Sci U S A. 2005 Oct 25;102(43):15377-82. doi: 10.1073/pnas.0503807102. Epub 2005 Oct 17.