Zilli Eric A, Hasselmo Michael E
Program in Neuroscience, Departmentof Psychology, Center for Memory and Brain, Boston University, Boston, Massachusetts 02215, USA.
Hippocampus. 2008;18(2):193-209. doi: 10.1002/hipo.20382.
The mechanisms of goal-directed behavior have been studied using reinforcement learning theory, but these theoretical techniques have not often been used to address the role of memory systems in performing behavioral tasks. This work addresses this shortcoming by providing a way in which working memory (WM) and episodic memory may be included in the reinforcement learning framework, then simulating the successful acquisition and performance of six behavioral tasks, drawn from or inspired by the rat experimental literature, that require WM or episodic memory for correct performance. With no delay imposed during the tasks, simulations with WM can solve all of the tasks at above the chance level. When a delay is imposed, simulations with both episodic memory and WM can solve all of the tasks except a disambiguation of odor sequences task.
目标导向行为的机制已通过强化学习理论进行研究,但这些理论技术并不常被用于探讨记忆系统在执行行为任务中的作用。这项工作通过提供一种方法来解决这一缺点,即将工作记忆(WM)和情景记忆纳入强化学习框架,然后模拟六项行为任务的成功习得和执行情况,这些任务取材于大鼠实验文献或受其启发,正确执行需要WM或情景记忆。在任务过程中不施加延迟时,使用WM的模拟能够以高于随机水平的概率解决所有任务。当施加延迟时,同时具有情景记忆和WM的模拟能够解决除气味序列辨别任务之外的所有任务。