• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

阴性症状与无法表征预期的行动奖励价值:行为及计算建模证据

Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence.

作者信息

Gold James M, Waltz James A, Matveeva Tatyana M, Kasanova Zuzana, Strauss Gregory P, Herbener Ellen S, Collins Anne G E, Frank Michael J

机构信息

Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore, MD 21228, USA.

出版信息

Arch Gen Psychiatry. 2012 Feb;69(2):129-38. doi: 10.1001/archgenpsychiatry.2011.1269.

DOI:10.1001/archgenpsychiatry.2011.1269
PMID:22310503
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4406055/
Abstract

CONTEXT

Negative symptoms are a core feature of schizophrenia, but their pathogenesis remains unclear. Negative symptoms are defined by the absence of normal function. However, there must be a productive mechanism that leads to this absence.

OBJECTIVE

To test a reinforcement learning account suggesting that negative symptoms result from a failure in the representation of the expected value of rewards coupled with preserved loss-avoidance learning.

DESIGN

Participants performed a probabilistic reinforcement learning paradigm involving stimulus pairs in which choices resulted in reward or in loss avoidance. Following training, participants indicated their valuation of the stimuli in a transfer test phase. Computational modeling was used to distinguish between alternative accounts of the data.

SETTING

A tertiary care research outpatient clinic.

PATIENTS

In total, 47 clinically stable patients with a diagnosis of schizophrenia or schizoaffective disorder and 28 healthy volunteers participated in the study. Patients were divided into a high-negative symptom group and a low-negative symptom group.

MAIN OUTCOME MEASURES

The number of choices leading to reward or loss avoidance, as well as performance in the transfer test phase. Quantitative fits from 3 different models were examined.

RESULTS

Patients in the high-negative symptom group demonstrated impaired learning from rewards but intact loss-avoidance learning and failed to distinguish rewarding stimuli from loss-avoiding stimuli in the transfer test phase. Model fits revealed that patients in the high-negative symptom group were better characterized by an "actor-critic" model, learning stimulus-response associations, whereas control subjects and patients in the low-negative symptom group incorporated expected value of their actions ("Q learning") into the selection process.

CONCLUSIONS

Negative symptoms in schizophrenia are associated with a specific reinforcement learning abnormality: patients with high-negative symptoms do not represent the expected value of rewards when making decisions but learn to avoid punishments through the use of prediction errors. This computational framework offers the potential to understand negative symptoms at a mechanistic level.

摘要

背景

阴性症状是精神分裂症的核心特征,但其发病机制仍不清楚。阴性症状是由正常功能的缺失所定义的。然而,必然存在一种导致这种缺失的产生机制。

目的

检验一种强化学习理论,该理论认为阴性症状是由于奖励预期值表征失败以及损失规避学习保留所致。

设计

参与者进行了一种概率强化学习范式,涉及刺激对,其中选择会导致奖励或损失规避。训练后,参与者在转移测试阶段表明他们对刺激的评估。使用计算模型来区分对数据的不同解释。

地点

一家三级护理研究门诊诊所。

患者

共有47名临床稳定的精神分裂症或分裂情感性障碍患者以及28名健康志愿者参与了该研究。患者被分为高阴性症状组和低阴性症状组。

主要观察指标

导致奖励或损失规避的选择数量,以及转移测试阶段的表现。检查了来自3种不同模型的定量拟合。

结果

高阴性症状组患者在从奖励中学习方面受损,但损失规避学习完好,并且在转移测试阶段未能区分奖励性刺激和损失规避性刺激。模型拟合显示,高阴性症状组患者更适合用“行动者-评论家”模型来表征,即学习刺激-反应关联,而对照组受试者和低阴性症状组患者在选择过程中纳入了其行动的预期值(“Q学习”)。

结论

精神分裂症的阴性症状与一种特定的强化学习异常有关:高阴性症状患者在做决策时不表征奖励的预期值,但通过利用预测误差来学习避免惩罚。这个计算框架为在机制层面理解阴性症状提供了可能性。

相似文献

1
Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence.阴性症状与无法表征预期的行动奖励价值:行为及计算建模证据
Arch Gen Psychiatry. 2012 Feb;69(2):129-38. doi: 10.1001/archgenpsychiatry.2011.1269.
2
Predicting psychosis across diagnostic boundaries: Behavioral and computational modeling evidence for impaired reinforcement learning in schizophrenia and bipolar disorder with a history of psychosis.跨越诊断界限预测精神病:精神分裂症和有精神病病史的双相情感障碍中强化学习受损的行为和计算建模证据。
J Abnorm Psychol. 2015 Aug;124(3):697-708. doi: 10.1037/abn0000039.
3
Retention of Value Representations Across Time in People With Schizophrenia and Healthy Control Subjects.精神分裂症患者和健康对照受试者价值表征随时间的保留情况
Biol Psychiatry Cogn Neurosci Neuroimaging. 2021 Apr;6(4):420-428. doi: 10.1016/j.bpsc.2020.05.009. Epub 2020 Jun 2.
4
Impaired Expected Value Computations Coupled With Overreliance on Stimulus-Response Learning in Schizophrenia.精神分裂症患者的预期价值计算受损,同时过度依赖刺激-反应学习。
Biol Psychiatry Cogn Neurosci Neuroimaging. 2018 Nov;3(11):916-926. doi: 10.1016/j.bpsc.2018.03.014. Epub 2018 Apr 3.
5
Reduced learning bias towards the reward context in medication-naive first-episode schizophrenia patients.药物初治首发精神分裂症患者对奖励环境的学习偏差降低。
BMC Psychiatry. 2022 Feb 16;22(1):123. doi: 10.1186/s12888-021-03682-5.
6
Impaired Expected Value Computations in Schizophrenia Are Associated With a Reduced Ability to Integrate Reward Probability and Magnitude of Recent Outcomes.精神分裂症患者的预期价值计算受损与整合近期结果的奖励概率和幅度的能力降低有关。
Biol Psychiatry Cogn Neurosci Neuroimaging. 2019 Mar;4(3):280-290. doi: 10.1016/j.bpsc.2018.11.011. Epub 2018 Dec 7.
7
Impulse control disorders in Parkinson's disease are associated with dysfunction in stimulus valuation but not action valuation.帕金森病中的冲动控制障碍与刺激评估而非行为评估的功能障碍有关。
J Neurosci. 2014 Jun 4;34(23):7814-24. doi: 10.1523/JNEUROSCI.4063-13.2014.
8
Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia.正强化学习和不确定性驱动的探索能力缺陷与精神分裂症阴性症状的不同方面相关。
Biol Psychiatry. 2011 Mar 1;69(5):424-31. doi: 10.1016/j.biopsych.2010.10.015. Epub 2010 Dec 17.
9
Deficits in reinforcement learning but no link to apathy in patients with schizophrenia.精神分裂症患者在强化学习中存在缺陷,但与冷漠无关。
Sci Rep. 2017 Jan 10;7:40352. doi: 10.1038/srep40352.
10
Reinforcement Learning Disruptions in Individuals With Depression and Sensitivity to Symptom Change Following Cognitive Behavioral Therapy.抑郁症患者的强化学习中断与认知行为治疗后症状变化的敏感性。
JAMA Psychiatry. 2021 Oct 1;78(10):1113-1122. doi: 10.1001/jamapsychiatry.2021.1844.

引用本文的文献

1
How working memory and reinforcement learning interact when avoiding punishment and pursuing reward concurrently.当同时避免惩罚和追求奖励时,工作记忆与强化学习是如何相互作用的。
J Exp Psychol Gen. 2025 Sep 1. doi: 10.1037/xge0001817.
2
Neural and Behavioral Markers of Negative Symptoms and Cognitive Impairment in Patients with Psychosis.精神病患者阴性症状和认知障碍的神经及行为标志物
J Neurosci. 2025 Jul 23;45(30):e0039252025. doi: 10.1523/JNEUROSCI.0039-25.2025.
3
Reinforcement learning impairment in individuals with euthymic bipolar I disorder with a history of psychosis.

本文引用的文献

1
From reinforcement learning models to psychiatric and neurological disorders.从强化学习模型到精神和神经疾病。
Nat Neurosci. 2011 Feb;14(2):154-62. doi: 10.1038/nn.2723.
2
Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia.正强化学习和不确定性驱动的探索能力缺陷与精神分裂症阴性症状的不同方面相关。
Biol Psychiatry. 2011 Mar 1;69(5):424-31. doi: 10.1016/j.biopsych.2010.10.015. Epub 2010 Dec 17.
3
Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making.
有精神病病史的心境正常的双相I型障碍患者的强化学习障碍。
Eur Arch Psychiatry Clin Neurosci. 2025 May 21. doi: 10.1007/s00406-025-02022-y.
4
Developing algorithmic psychiatry via multi-level spanning computational models.通过多层次跨尺度计算模型发展算法精神病学。
Cell Rep Med. 2025 May 20;6(5):102094. doi: 10.1016/j.xcrm.2025.102094. Epub 2025 Apr 28.
5
Exploratory analysis of the relationship between striatal connectivity and apathy during phosphodiesterase 10 inhibition in schizophrenia: findings from a randomized crossover trial.精神分裂症患者在磷酸二酯酶10抑制过程中纹状体连接性与冷漠之间关系的探索性分析:一项随机交叉试验的结果
BMC Med. 2025 Mar 28;23(1):187. doi: 10.1186/s12916-025-04004-2.
6
Evidence for shallow cognitive maps in Schizophrenia.精神分裂症中浅层认知地图的证据。
Cogn Affect Behav Neurosci. 2025 Mar 20. doi: 10.3758/s13415-025-01283-3.
7
Probabalistic reinforcement learning impairments predict negative symptom severity and risk for conversion in youth at clinical high-risk for psychosis.概率强化学习障碍可预测临床高危青少年精神病患者的阴性症状严重程度及转化风险。
Psychol Med. 2025 Feb 6;55:e28. doi: 10.1017/S0033291724003416.
8
A generalized reward processing deficit pathway to negative symptoms across diagnostic boundaries.一条跨越诊断界限导致阴性症状的广义奖励处理缺陷通路。
Psychol Med. 2025 Feb 4;55:e6. doi: 10.1017/S003329172400326X.
9
The neuroscience of mental illness: Building toward the future.精神疾病的神经科学:面向未来的发展。
Cell. 2024 Oct 17;187(21):5858-5870. doi: 10.1016/j.cell.2024.09.028.
10
The mesolimbic system and the loss of higher order network features in schizophrenia when learning without reward.中脑边缘系统与精神分裂症患者在无奖励学习时高阶网络特征的丧失。
Front Psychiatry. 2024 Sep 3;15:1337882. doi: 10.3389/fpsyt.2024.1337882. eCollection 2024.
在做决策时,奖赏和惩罚目标值被编码在眶额内侧皮质。
J Neurosci. 2010 Aug 11;30(32):10799-808. doi: 10.1523/JNEUROSCI.0788-10.2010.
4
Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task.在一项学习空间决策任务中,背侧纹状体、腹侧纹状体和海马体在信息处理方面的三重分离。
Neuron. 2010 Jul 15;67(1):25-32. doi: 10.1016/j.neuron.2010.06.023.
5
Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions.精神分裂症中的目标表示和动机驱动:前额叶-纹状体相互作用的作用。
Schizophr Bull. 2010 Sep;36(5):919-34. doi: 10.1093/schbul/sbq068. Epub 2010 Jun 21.
6
Dopaminergic dysfunction in schizophrenia: salience attribution revisited.精神分裂症中的多巴胺能功能障碍:重新审视突显归因。
Schizophr Bull. 2010 May;36(3):472-85. doi: 10.1093/schbul/sbq031. Epub 2010 May 7.
7
How do you (estimate you will) like them apples? Integration as a defining trait of orbitofrontal function.你觉得怎么样?整合是眶额皮质功能的一个决定性特征。
Curr Opin Neurobiol. 2010 Apr;20(2):205-11. doi: 10.1016/j.conb.2010.01.009. Epub 2010 Mar 4.
8
Two-factor theory, the actor-critic model, and conditioned avoidance.双因素理论、行动者-评论家模型与条件性回避。
Learn Behav. 2010 Feb;38(1):50-67. doi: 10.3758/LB.38.1.50.
9
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour.眶额皮质在适应性行为中作用的新视角。
Nat Rev Neurosci. 2009 Dec;10(12):885-92. doi: 10.1038/nrn2753. Epub 2009 Nov 11.
10
Reinforcement learning, conditioning, and the brain: Successes and challenges.强化学习、条件作用与大脑:成就与挑战。
Cogn Affect Behav Neurosci. 2009 Dec;9(4):343-64. doi: 10.3758/CABN.9.4.343.