Suppr超能文献

精神分裂症中的奖赏-复杂性权衡

The Reward-Complexity Trade-off in Schizophrenia.

作者信息

Gershman Samuel J, Lai Lucy

机构信息

Department of Psychology and Center for Brain Science, Harvard University, US.

Center for Brains, Minds and Machines, MIT, US.

出版信息

Comput Psychiatr. 2021 May 25;5(1):38-53. doi: 10.5334/cpsy.71. eCollection 2021.

Abstract

Action selection requires a policy that maps states of the world to a distribution over actions. The amount of memory needed to specify the policy (the policy complexity) increases with the state-dependence of the policy. If there is a capacity limit for policy complexity, then there will also be a trade-off between reward and complexity, since some reward will need to be sacrificed in order to satisfy the capacity constraint. This paper empirically characterizes the trade-off between reward and complexity for both schizophrenia patients and healthy controls. Schizophrenia patients adopt lower complexity policies on average, and these policies are more strongly biased away from the optimal reward-complexity trade-off curve compared to healthy controls. However, healthy controls are also biased away from the optimal trade-off curve, and both groups appear to lie on the same empirical trade-off curve. We explain these findings using a cost-sensitive actor-critic model. Our empirical and theoretical results shed new light on cognitive effort abnormalities in schizophrenia.

摘要

动作选择需要一种将世界状态映射到动作分布的策略。指定该策略所需的内存量(策略复杂度)会随着策略的状态依赖性而增加。如果策略复杂度存在容量限制,那么在奖励和复杂度之间也会存在权衡,因为为了满足容量约束需要牺牲一些奖励。本文通过实证研究了精神分裂症患者和健康对照在奖励与复杂度之间的权衡。平均而言,精神分裂症患者采用复杂度较低的策略,与健康对照相比,这些策略更明显地偏离了最优奖励 - 复杂度权衡曲线。然而,健康对照也偏离了最优权衡曲线,并且两组似乎都位于同一条经验权衡曲线上。我们使用一种成本敏感型行为 - 评判模型来解释这些发现。我们的实证和理论结果为精神分裂症的认知努力异常提供了新的见解。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6809/11104411/c90b4e184af2/cpsy-5-1-71-g1.jpg

相似文献

1
The Reward-Complexity Trade-off in Schizophrenia.
Comput Psychiatr. 2021 May 25;5(1):38-53. doi: 10.5334/cpsy.71. eCollection 2021.
2
Origin of perseveration in the trade-off between reward and complexity.
Cognition. 2020 Nov;204:104394. doi: 10.1016/j.cognition.2020.104394. Epub 2020 Jul 14.
3
Human decision making balances reward maximization and policy compression.
PLoS Comput Biol. 2024 Apr 26;20(4):e1012057. doi: 10.1371/journal.pcbi.1012057. eCollection 2024 Apr.
4
The value-complexity trade-off for reinforcement learning based brain-computer interfaces.
J Neural Eng. 2021 Feb 13;17(6):066011. doi: 10.1088/1741-2552/abc8d8.
5
Undermatching Is a Consequence of Policy Compression.
J Neurosci. 2023 Jan 18;43(3):447-457. doi: 10.1523/JNEUROSCI.1003-22.2022. Epub 2022 Dec 6.
6
Dopamine Manipulation Affects Response Vigor Independently of Opportunity Cost.
J Neurosci. 2016 Sep 14;36(37):9516-25. doi: 10.1523/JNEUROSCI.4467-15.2016.
7
Impaired Expected Value Computations Coupled With Overreliance on Stimulus-Response Learning in Schizophrenia.
Biol Psychiatry Cogn Neurosci Neuroimaging. 2018 Nov;3(11):916-926. doi: 10.1016/j.bpsc.2018.03.014. Epub 2018 Apr 3.
8
Meta attention for Off-Policy Actor-Critic.
Neural Netw. 2023 Jun;163:86-96. doi: 10.1016/j.neunet.2023.03.024. Epub 2023 Mar 28.
9
Cost-benefit trade-offs in decision-making and learning.
PLoS Comput Biol. 2019 Sep 6;15(9):e1007326. doi: 10.1371/journal.pcbi.1007326. eCollection 2019 Sep.
10
Adaptive bias-variance trade-off in advantage estimator for actor-critic algorithms.
Neural Netw. 2024 Jan;169:764-777. doi: 10.1016/j.neunet.2023.10.023. Epub 2023 Oct 31.

引用本文的文献

1
Computationally Informed Insights Into Anhedonia and Treatment by Kappa Opioid Receptor Antagonism.
Biol Psychiatry Cogn Neurosci Neuroimaging. 2025 May 28. doi: 10.1016/j.bpsc.2025.05.011.
2
Time and memory costs jointly determine a speed-accuracy trade-off and set-size effects.
J Exp Psychol Gen. 2025 Jun;154(6):1611-1627. doi: 10.1037/xge0001760. Epub 2025 Apr 7.
3
Resource-rational psychopathology.
Behav Neurosci. 2024 Aug;138(4):221-234. doi: 10.1037/bne0000600. Epub 2024 May 16.
4
Human decision making balances reward maximization and policy compression.
PLoS Comput Biol. 2024 Apr 26;20(4):e1012057. doi: 10.1371/journal.pcbi.1012057. eCollection 2024 Apr.
5
Bayesian Reinforcement Learning With Limited Cognitive Load.
Open Mind (Camb). 2024 Apr 3;8:395-438. doi: 10.1162/opmi_a_00132. eCollection 2024.
6
Undermatching Is a Consequence of Policy Compression.
J Neurosci. 2023 Jan 18;43(3):447-457. doi: 10.1523/JNEUROSCI.1003-22.2022. Epub 2022 Dec 6.
7
Atypical meta-memory evaluation strategy in schizophrenia patients.
Schizophr Res Cogn. 2021 Oct 6;27:100220. doi: 10.1016/j.scog.2021.100220. eCollection 2022 Mar.

本文引用的文献

1
Origin of perseveration in the trade-off between reward and complexity.
Cognition. 2020 Nov;204:104394. doi: 10.1016/j.cognition.2020.104394. Epub 2020 Jul 14.
2
Efficient data compression in perception and perceptual memory.
Psychol Rev. 2020 Oct;127(5):891-917. doi: 10.1037/rev0000197. Epub 2020 Apr 23.
3
Discovery of hierarchical representations for efficient planning.
PLoS Comput Biol. 2020 Apr 6;16(4):e1007594. doi: 10.1371/journal.pcbi.1007594. eCollection 2020 Apr.
4
Cognitive effort and amotivation in first-episode psychosis.
J Abnorm Psychol. 2020 May;129(4):422-431. doi: 10.1037/abn0000509. Epub 2020 Mar 12.
5
The transdiagnostic structure of mental effort avoidance.
Sci Rep. 2019 Feb 8;9(1):1689. doi: 10.1038/s41598-018-37802-1.
6
Motivational deficits in schizophrenia relate to abnormalities in cortical learning rate signals.
Cogn Affect Behav Neurosci. 2018 Dec;18(6):1338-1351. doi: 10.3758/s13415-018-0643-z.
7
Effort-Based Decision-Making in Schizophrenia.
Curr Opin Behav Sci. 2018 Aug;22:1-6. doi: 10.1016/j.cobeha.2017.12.003. Epub 2017 Dec 22.
8
Within- and across-trial dynamics of human EEG reveal cooperative interplay between reinforcement learning and working memory.
Proc Natl Acad Sci U S A. 2018 Mar 6;115(10):2502-2507. doi: 10.1073/pnas.1720963115. Epub 2018 Feb 20.
9
The Tortoise and the Hare: Interactions between Reinforcement Learning and Working Memory.
J Cogn Neurosci. 2018 Oct;30(10):1422-1432. doi: 10.1162/jocn_a_01238. Epub 2018 Jan 18.
10

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验