Groman Stephanie M
Department of Psychiatry, Yale University, New Haven, CT, USA.
Curr Top Behav Neurosci. 2020;47:23-52. doi: 10.1007/7854_2020_127.
Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.
冲动决策是指那些更青睐即时奖励而非延迟奖励、涉及接受不当风险或不确定性，或者无法适应环境变化的决策。在患有精神疾病的个体中已观察到冲动决策的病理水平，但驱动冲动选择的过程可能存在很大的异质性。理解这种行为异质性对于理解导致冲动性的神经机制中的相关多样性可能至关重要。强化学习算法在冲动决策表型解构中的应用有助于弥合生物学与行为之间的差距，并为冲动选择的生物行为异质性提供见解。本章将综述关于非人类动物冲动决策神经生物学机制的文献；具体而言，将讨论胺类神经调节系统（多巴胺、血清素、去甲肾上腺素和乙酰胆碱）在冲动决策和强化学习过程中的作用。最终，将强化学习算法与复杂的行为和神经科学技术相结合，对于推进对冲动决策神经化学基础的理解可能至关重要。
