Suppr超能文献

模拟工作记忆和情景记忆在行为任务中的作用。

Modeling the role of working memory and episodic memory in behavioral tasks.

作者信息

Zilli Eric A, Hasselmo Michael E

机构信息

Program in Neuroscience, Departmentof Psychology, Center for Memory and Brain, Boston University, Boston, Massachusetts 02215, USA.

出版信息

Hippocampus. 2008;18(2):193-209. doi: 10.1002/hipo.20382.

Abstract

The mechanisms of goal-directed behavior have been studied using reinforcement learning theory, but these theoretical techniques have not often been used to address the role of memory systems in performing behavioral tasks. This work addresses this shortcoming by providing a way in which working memory (WM) and episodic memory may be included in the reinforcement learning framework, then simulating the successful acquisition and performance of six behavioral tasks, drawn from or inspired by the rat experimental literature, that require WM or episodic memory for correct performance. With no delay imposed during the tasks, simulations with WM can solve all of the tasks at above the chance level. When a delay is imposed, simulations with both episodic memory and WM can solve all of the tasks except a disambiguation of odor sequences task.

摘要

目标导向行为的机制已通过强化学习理论进行研究,但这些理论技术并不常被用于探讨记忆系统在执行行为任务中的作用。这项工作通过提供一种方法来解决这一缺点,即将工作记忆(WM)和情景记忆纳入强化学习框架,然后模拟六项行为任务的成功习得和执行情况,这些任务取材于大鼠实验文献或受其启发,正确执行需要WM或情景记忆。在任务过程中不施加延迟时,使用WM的模拟能够以高于随机水平的概率解决所有任务。当施加延迟时,同时具有情景记忆和WM的模拟能够解决除气味序列辨别任务之外的所有任务。

相似文献

1
Modeling the role of working memory and episodic memory in behavioral tasks.
Hippocampus. 2008;18(2):193-209. doi: 10.1002/hipo.20382.
2
Memory Transformation Enhances Reinforcement Learning in Dynamic Environments.
J Neurosci. 2016 Nov 30;36(48):12228-12242. doi: 10.1523/JNEUROSCI.0763-16.2016.
4
Working and reference memory across the estrous cycle of rat: a long-term study in gonadally intact females.
Behav Brain Res. 2010 Nov 12;213(1):10-8. doi: 10.1016/j.bbr.2010.04.018. Epub 2010 Apr 21.
5
Prefrontal working memory activity predicts episodic memory performance: A neuroimaging study.
Behav Brain Res. 2020 Feb 3;379:112307. doi: 10.1016/j.bbr.2019.112307. Epub 2019 Oct 31.
7
A study of hippocampal structure-function relations along the septo-temporal axis.
Hippocampus. 2012 Apr;22(4):680-92. doi: 10.1002/hipo.20928. Epub 2011 Apr 27.
8
An overview of the tasks used to test working memory in rodents.
Neurosci Biobehav Rev. 2004 Nov;28(7):699-709. doi: 10.1016/j.neubiorev.2004.09.002.
9
Adolescent and adult mice use both incremental reinforcement learning and short term memory when learning concurrent stimulus-action associations.
PLoS Comput Biol. 2024 Dec 23;20(12):e1012667. doi: 10.1371/journal.pcbi.1012667. eCollection 2024 Dec.

引用本文的文献

1
Medial septal theta stimulation enhances spatial working memory performance in rats.
Learn Mem. 2025 Apr 10;32(4). doi: 10.1101/lm.054075.124. Print 2025 Apr.
2
On the Role of Theory and Modeling in Neuroscience.
J Neurosci. 2023 Feb 15;43(7):1074-1088. doi: 10.1523/JNEUROSCI.1179-22.2022.
3
Etiopathogenic Models of Psychosis Spectrum Illnesses Must Resolve Four Key Features.
Biol Psychiatry. 2022 Sep 15;92(6):514-522. doi: 10.1016/j.biopsych.2022.06.024. Epub 2022 Jun 25.
5
A neural network model of when to retrieve and encode episodic memories.
Elife. 2022 Feb 10;11:e74445. doi: 10.7554/eLife.74445.
6
Evidence for a gradient within the medial temporal lobes for flexible retrieval under hierarchical task rules.
Hippocampus. 2021 Sep;31(9):1003-1019. doi: 10.1002/hipo.23365. Epub 2021 May 26.
7
Memory Alone Does Not Account for the Way Rats Learn a Simple Spatial Alternation Task.
J Neurosci. 2020 Sep 16;40(38):7311-7317. doi: 10.1523/JNEUROSCI.0972-20.2020. Epub 2020 Aug 4.
9
Neural Representation of Overlapping Path Segments and Reward Acquisitions in the Monkey Hippocampus.
Front Syst Neurosci. 2019 Sep 12;13:48. doi: 10.3389/fnsys.2019.00048. eCollection 2019.
10
The Complex Nature of Hippocampal-Striatal Interactions in Spatial Navigation.
Front Hum Neurosci. 2018 Jun 21;12:250. doi: 10.3389/fnhum.2018.00250. eCollection 2018.

本文引用的文献

3
Hippocampal sharp waves and reactivation during awake states depend on repeated sequential experience.
J Neurosci. 2006 Nov 29;26(48):12415-26. doi: 10.1523/JNEUROSCI.4118-06.2006.
4
The short-latency dopamine signal: a role in discovering novel actions?
Nat Rev Neurosci. 2006 Dec;7(12):967-75. doi: 10.1038/nrn2022. Epub 2006 Nov 8.
6
Midbrain dopamine neurons encode decisions for future action.
Nat Neurosci. 2006 Aug;9(8):1057-63. doi: 10.1038/nn1743. Epub 2006 Jul 23.
7
Reverse replay of behavioural sequences in hippocampal place cells during the awake state.
Nature. 2006 Mar 30;440(7084):680-3. doi: 10.1038/nature04587. Epub 2006 Feb 12.
8
Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia.
Neural Comput. 2006 Feb;18(2):283-328. doi: 10.1162/089976606775093909.
10
Hippocampal mechanisms for the context-dependent retrieval of episodes.
Neural Netw. 2005 Nov;18(9):1172-90. doi: 10.1016/j.neunet.2005.08.007. Epub 2005 Nov 2.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验