Suppr超能文献

作为受限熵最大化的内在动机。

Intrinsic Motivation as Constrained Entropy Maximization.

作者信息

Kiefer Alex B

机构信息

VERSES, Los Angeles, CA 90016, USA.

Monash Centre for Consciousness and Contemplative Studies, Monash University, Melbourne, VIC 3800, Australia.

出版信息

Entropy (Basel). 2025 Mar 31;27(4):372. doi: 10.3390/e27040372.

Abstract

"Intrinsic motivation" refers to the capacity for intelligent systems to be motivated endogenously, i.e., by features of agential architecture itself rather than by learned associations between action and reward. This paper views active inference, empowerment, and other formal accounts of intrinsic motivation as variations on the theme of constrained maximum entropy inference, providing a general perspective on intrinsic motivation complementary to existing frameworks. The connection between free energy and empowerment noted in previous literature is further explored, and it is argued that the maximum-occupancy approach in practice incorporates an implicit model-evidence constraint.

摘要

“内在动机”指智能系统内在激发的能力,即由智能体架构本身的特征激发,而非通过行动与奖励之间的习得关联激发。本文将主动推理、赋能及其他内在动机的形式化描述视为约束最大熵推理主题的变体,提供了一个与现有框架互补的内在动机通用视角。进一步探讨了先前文献中提到的自由能与赋能之间的联系,并认为实践中的最大占有率方法包含了一个隐含的模型证据约束。

相似文献

1
Intrinsic Motivation as Constrained Entropy Maximization.
Entropy (Basel). 2025 Mar 31;27(4):372. doi: 10.3390/e27040372.
2
Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop.
Front Neurorobot. 2018 Aug 30;12:45. doi: 10.3389/fnbot.2018.00045. eCollection 2018.
3
Complex behavior from intrinsic motivation to occupy future action-state path space.
Nat Commun. 2024 Jul 29;15(1):6368. doi: 10.1038/s41467-024-49711-1.
4
Intrinsic motivation: how can it play a pivotal role in changing clinician behaviour?
J Health Organ Manag. 2013;27(2):266-72. doi: 10.1108/14777261311321815.
5
The value of uncertainty: An active inference perspective.
Behav Brain Sci. 2019 Jan;42:e47. doi: 10.1017/S0140525X18002066.
7
The anatomy of choice: dopamine and decision-making.
Philos Trans R Soc Lond B Biol Sci. 2014 Nov 5;369(1655). doi: 10.1098/rstb.2013.0481.
9
On what motivates us: a detailed review of intrinsic extrinsic motivation.
Psychol Med. 2022 Jul;52(10):1801-1816. doi: 10.1017/S0033291722001611. Epub 2022 Jul 7.
10
Reward Maximization Through Discrete Active Inference.
Neural Comput. 2023 Apr 18;35(5):807-852. doi: 10.1162/neco_a_01574.

本文引用的文献

1
Supervised structure learning.
Biol Psychol. 2024 Nov;193:108891. doi: 10.1016/j.biopsycho.2024.108891. Epub 2024 Oct 19.
2
Making the Thermodynamic Cost of Active Inference Explicit.
Entropy (Basel). 2024 Jul 24;26(8):622. doi: 10.3390/e26080622.
3
Complex behavior from intrinsic motivation to occupy future action-state path space.
Nat Commun. 2024 Jul 29;15(1):6368. doi: 10.1038/s41467-024-49711-1.
4
Path integrals, particular kinds, and strange things.
Phys Life Rev. 2023 Dec;47:35-62. doi: 10.1016/j.plrev.2023.08.016. Epub 2023 Aug 29.
5
A step-by-step tutorial on active inference and its application to empirical data.
J Math Psychol. 2022 Apr;107. doi: 10.1016/j.jmp.2021.102632. Epub 2022 Feb 4.
6
Achieving natural behavior in a robot using neurally inspired hierarchical perceptual control.
iScience. 2021 Aug 4;24(9):102948. doi: 10.1016/j.isci.2021.102948. eCollection 2021 Sep 24.
7
The perceptual control model of psychopathology.
Curr Opin Psychol. 2021 Oct;41:15-20. doi: 10.1016/j.copsyc.2021.01.008. Epub 2021 Feb 6.
8
Sophisticated Inference.
Neural Comput. 2021 Mar;33(3):713-763. doi: 10.1162/neco_a_01351.
9
Whence the Expected Free Energy?
Neural Comput. 2021 Feb;33(2):447-482. doi: 10.1162/neco_a_01354. Epub 2021 Jan 5.
10
Psychophysical identity and free energy.
J R Soc Interface. 2020 Aug;17(169):20200370. doi: 10.1098/rsif.2020.0370. Epub 2020 Aug 5.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验