Suppr超能文献

基于模型的强化学习更新过程中额顶网络活动在遭受严重性虐待的青少年中减少。

Frontoparietal network activity during model-based reinforcement learning updates is reduced among adolescents with severe sexual abuse.

机构信息

Department of Psychiatry and Behavioral Sciences, Northwestern University, Chicago, IL, USA.

Departments of Math and Population Health Sciences, University of Wisconsin, Madison, WI, USA.

出版信息

J Psychiatr Res. 2022 Jan;145:256-262. doi: 10.1016/j.jpsychires.2020.10.046. Epub 2020 Nov 4.

Abstract

Trauma and trauma-related disorders are characterized by impaired learning processes, including reinforcement learning (RL). Identifying which aspects of learning are altered by trauma is critical endeavor, as this may reveal key mechanisms of impairment and potential intervention targets. There are at least two types of RL that have been delineated using computational modeling: model-free and model-based RL. Although these RL processes differentially predict decision-making behavior, most research has examined the impact of trauma on model-free RL. Currently unclear whether model-based RL, which involves building abstract and nuanced representations of stimulus-outcome relationships, is impaired among individuals with a history of trauma. The present study sought to test the hypothesis of impaired model-based RL among adolescent females exposed to assaultive trauma. Participants (n = 60; 29 without a history of assault and 31 with a history of assault with and without PTSD) completed a three-arm bandit task during fMRI acquisition. Two computational models compared the degree to which participants' task behavior fit the use of a model-free versus model-based RL strategy. Although a history of assaultive trauma did not predict poorer model-based RL, greater sexual abuse severity predicted less use of model-based compared to model-free RL. Additionally, severe sexual abuse predicted less left frontoparietal network encoding of model-based RL updates. Altered model-based RL, which supports goal-directed behavior, may be an important route through which clinical impairment emerges among individuals with a history of severe sexual abuse and should be examined further in future studies.

摘要

创伤和与创伤相关的障碍的特征是学习过程受损,包括强化学习(RL)。确定创伤改变了哪些学习方面是至关重要的,因为这可能揭示了损伤的关键机制和潜在的干预靶点。至少有两种使用计算建模来描述的 RL:无模型 RL 和基于模型的 RL。尽管这些 RL 过程对决策行为有不同的预测作用,但大多数研究都考察了创伤对无模型 RL 的影响。目前尚不清楚是否存在创伤史个体的基于模型的 RL 受损,因为基于模型的 RL 涉及到建立刺激-结果关系的抽象和微妙表示。本研究旨在检验遭受攻击创伤的青春期女性存在基于模型 RL 受损的假设。参与者(n=60;29 名无创伤史,31 名有创伤史,其中包括 PTSD)在 fMRI 采集期间完成了三臂赌博任务。两个计算模型比较了参与者的任务行为与无模型 RL 与基于模型 RL 策略的拟合程度。尽管创伤史攻击不预示着基于模型 RL 较差,但性虐待严重程度越高,基于模型 RL 与无模型 RL 相比,使用的模型就越少。此外,严重的性虐待预示着基于模型 RL 更新的左额顶网络编码较少。改变基于模型的 RL,这支持目标导向的行为,可能是一个重要的途径,通过这种途径,有严重性虐待史的个体出现临床损伤,应在未来的研究中进一步研究。

相似文献

1
Frontoparietal network activity during model-based reinforcement learning updates is reduced among adolescents with severe sexual abuse.
J Psychiatr Res. 2022 Jan;145:256-262. doi: 10.1016/j.jpsychires.2020.10.046. Epub 2020 Nov 4.
2
Value estimation and latent-state update-related neural activity during fear conditioning predict posttraumatic stress disorder symptom severity.
Cogn Affect Behav Neurosci. 2022 Feb;22(1):199-213. doi: 10.3758/s13415-021-00943-4. Epub 2021 Aug 26.
3
Differential Roles of the Salience Network During Prediction Error Encoding and Facial Emotion Processing Among Female Adolescent Assault Victims.
Biol Psychiatry Cogn Neurosci Neuroimaging. 2019 Apr;4(4):371-380. doi: 10.1016/j.bpsc.2018.08.014. Epub 2018 Sep 11.
4
Brain and behavioral evidence for altered social learning mechanisms among women with assault-related posttraumatic stress disorder.
J Psychiatr Res. 2015 Apr;63:75-83. doi: 10.1016/j.jpsychires.2015.02.014. Epub 2015 Feb 24.
5
Computational evidence for hierarchically structured reinforcement learning in humans.
Proc Natl Acad Sci U S A. 2020 Nov 24;117(47):29381-29389. doi: 10.1073/pnas.1912330117.
6
Multiple memory systems as substrates for multiple decision systems.
Neurobiol Learn Mem. 2015 Jan;117:4-13. doi: 10.1016/j.nlm.2014.04.014. Epub 2014 May 15.
8
Neural Index of Reinforcement Learning Predicts Improved Stimulus-Response Retention under High Working Memory Load.
J Neurosci. 2023 Apr 26;43(17):3131-3143. doi: 10.1523/JNEUROSCI.1274-22.2023. Epub 2023 Mar 17.
10

引用本文的文献

1
How childhood adversity affects components of decision making.
Neurosci Biobehav Rev. 2025 Feb;169:106027. doi: 10.1016/j.neubiorev.2025.106027. Epub 2025 Jan 25.
3
Severe sexual abuse in childhood and altered neurophysiological response to reward in female adults.
Child Abuse Negl. 2024 Aug;154:106945. doi: 10.1016/j.chiabu.2024.106945. Epub 2024 Jul 15.
6
Latent-state and model-based learning in PTSD.
Trends Neurosci. 2024 Feb;47(2):150-162. doi: 10.1016/j.tins.2023.12.002. Epub 2024 Jan 11.
7
Quantifying aberrant approach-avoidance conflict in psychopathology: A review of computational approaches.
Neurosci Biobehav Rev. 2023 Apr;147:105103. doi: 10.1016/j.neubiorev.2023.105103. Epub 2023 Feb 17.
8
Large-scale neural network computations and multivariate representations during approach-avoidance conflict decision-making.
Neuroimage. 2022 Dec 1;264:119709. doi: 10.1016/j.neuroimage.2022.119709. Epub 2022 Oct 22.
9
Neurobiological Alterations in Females With PTSD: A Systematic Review.
Front Psychiatry. 2022 Jun 13;13:862476. doi: 10.3389/fpsyt.2022.862476. eCollection 2022.
10
Functional imaging correlates of childhood trauma: A qualitative review of past research and emerging trends.
Pharmacol Biochem Behav. 2021 Dec;211:173297. doi: 10.1016/j.pbb.2021.173297. Epub 2021 Nov 12.

本文引用的文献

1
Reward Processing and Decision-Making in Posttraumatic Stress Disorder.
Behav Ther. 2020 Sep;51(5):814-828. doi: 10.1016/j.beth.2019.11.005. Epub 2019 Nov 26.
2
A flexible and generalizable model of online latent-state learning.
PLoS Comput Biol. 2019 Sep 16;15(9):e1007331. doi: 10.1371/journal.pcbi.1007331. eCollection 2019 Sep.
3
Early ERP components to emotional facial expressions in young adult victims of childhood maltreatment.
Psychiatry Res. 2019 May;275:120-128. doi: 10.1016/j.psychres.2019.03.024. Epub 2019 Mar 15.
4
Differential Roles of the Salience Network During Prediction Error Encoding and Facial Emotion Processing Among Female Adolescent Assault Victims.
Biol Psychiatry Cogn Neurosci Neuroimaging. 2019 Apr;4(4):371-380. doi: 10.1016/j.bpsc.2018.08.014. Epub 2018 Sep 11.
5
Altered neural encoding of prediction errors in assault-related posttraumatic stress disorder.
J Psychiatr Res. 2018 Aug;103:83-90. doi: 10.1016/j.jpsychires.2018.05.008. Epub 2018 May 12.
6
7
Emotional face processing in adolescents with childhood sexual abuse-related posttraumatic stress disorder, internalizing disorders and healthy controls.
Psychiatry Res Neuroimaging. 2017 Jun 30;264:52-59. doi: 10.1016/j.pscychresns.2017.04.006. Epub 2017 Apr 18.
8
From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning.
Psychol Sci. 2016 Jun;27(6):848-58. doi: 10.1177/0956797616639301. Epub 2016 Apr 15.
9
Dysfunctional Reward Processing in Depression.
Curr Opin Psychol. 2015 Aug 1;4:114-118. doi: 10.1016/j.copsyc.2014.12.011.
10
A longitudinal study of experiential avoidance in emotional disorders.
Behav Ther. 2014 Nov;45(6):840-50. doi: 10.1016/j.beth.2014.07.001. Epub 2014 Jul 18.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验