Laboratory for Integrative Neuroscience, Division of Intramural Clinical and Biological Research, National Institute on Alcohol Abuse and Alcoholism, NIH, Bethesda, MD, USA; Center on Compulsive Behaviors, Intramural Research Program, NIH, Bethesda, MD, USA.
Center on Compulsive Behaviors, Intramural Research Program, NIH, Bethesda, MD, USA; Behavioral Neuroscience Research Branch, Intramural Research Program, National Institute on Drug Abuse, NIH, Baltimore, MD, USA.
Prog Neurobiol. 2022 May;212:102252. doi: 10.1016/j.pneurobio.2022.102252. Epub 2022 Feb 25.
Reinforcement learning and goal-seeking behavior are thought to be mediated by midbrain dopamine neurons. However, little is known about neural substrates of curiosity and exploratory behavior, which occur in the absence of clear goal or reward. This is despite behavioral scientists having long suggested that curiosity and exploratory behaviors are regulated by an innate drive. We refer to such behavior as information-seeking behavior and propose 1) key neural substrates and 2) the concept of environment prediction error as a framework to understand information-seeking processes. The cognitive aspect of information-seeking behavior, including the perception of salience and uncertainty, involves, in part, the pathways from the posterior hypothalamic supramammillary region to the hippocampal formation. The vigor of such behavior is modulated by the following: supramammillary glutamatergic neurons; their projections to medial septal glutamatergic neurons; and the projections of medial septal glutamatergic neurons to ventral tegmental dopaminergic neurons. Phasic responses of dopaminergic neurons are characterized as signaling potentially important stimuli rather than rewards. This paper describes how novel stimuli and uncertainty trigger seeking motivation and how these neural substrates modulate information-seeking behavior.
强化学习和目标寻求行为被认为是由中脑多巴胺神经元介导的。然而,对于好奇心和探索性行为的神经基质知之甚少,这些行为发生在没有明确目标或奖励的情况下。尽管行为科学家早就提出好奇心和探索性行为是由一种内在的驱动力调节的,但情况却并非如此。我们将这种行为称为信息寻求行为,并提出 1)关键的神经基质和 2)环境预测误差的概念,作为理解信息寻求过程的框架。信息寻求行为的认知方面,包括对显着性和不确定性的感知,部分涉及从下丘脑后穹窿区到海马结构的途径。这种行为的活力受到以下因素的调节:穹窿上谷氨酸能神经元;它们投射到中隔核的谷氨酸能神经元;以及中隔核的谷氨酸能神经元投射到腹侧被盖区多巴胺能神经元。多巴胺能神经元的相位反应特征是信号潜在的重要刺激而不是奖励。本文描述了新的刺激和不确定性如何引发寻求动机,以及这些神经基质如何调节信息寻求行为。