Wellcome Trust Centre for Neuroimaging, University College London, London, UK.
Eur J Neurosci. 2012 Apr;35(7):1052-64. doi: 10.1111/j.1460-9568.2012.08058.x.
Although delay discounting, the attenuation of the value of future rewards, is a robust finding, the mechanism of discounting is not known. We propose a potential mechanism for delay discounting such that discounting emerges from a search process that is trying to determine what rewards will be available in the future. In this theory, the delay dependence of the discounting of future expected rewards arises from three assumptions. First, that the evaluation of outcomes involves a search process. Second, that the value is assigned to an outcome proportionally to how easy it is to find. Third, that outcomes that are less delayed are typically easier for the search process to find. By relaxing this third assumption (e.g. by assuming that episodically-cued outcomes are easier to find), our model suggests that it is possible to dissociate discounting from delay. Our theory thereby explains the empirical result that discounting is slower to episodically-imagined outcomes, because these outcomes are easier for the search process to find. Additionally, the theory explains why improving cognitive resources such as working memory slows discounting, by improving searches and thereby making rewards easier to find. The three assumptions outlined here are likely to be instantiated during deliberative decision-making, but are unlikely in habitual decision-making. We model two simple implementations of this theory and show that they unify empirical results about the role of cognitive function in delay discounting, and make new neural, behavioral, and pharmacological predictions.
尽管延迟折扣,即未来奖励价值的衰减,是一个强有力的发现,但折扣的机制尚不清楚。我们提出了一种潜在的延迟折扣机制,即折扣的出现源于一种搜索过程,旨在确定未来将有哪些奖励。在这个理论中,未来预期奖励的折扣随时间的变化依赖于三个假设。首先,对结果的评估涉及搜索过程。其次,价值是根据搜索的难易程度按比例分配给结果的。第三,延迟较小的结果通常更容易被搜索过程找到。通过放松第三个假设(例如,假设情节线索的结果更容易找到),我们的模型表明,将折扣与延迟分离是可能的。因此,我们的理论解释了折扣对情节想象的结果较慢的经验结果,因为这些结果更容易被搜索过程找到。此外,该理论还解释了为什么改善工作记忆等认知资源会减缓折扣,因为这会改善搜索,从而使奖励更容易找到。这里概述的三个假设很可能在深思熟虑的决策中得到体现,但不太可能在习惯性决策中体现。我们对该理论的两个简单实现进行了建模,并表明它们统一了认知功能在延迟折扣中的作用的实证结果,并提出了新的神经、行为和药理学预测。