Schultz W, Dayan P, Montague P R
Institute of Physiology, University of Fribourg, CH-1700 Fribourg, Switzerland.
Science. 1997 Mar 14;275(5306):1593-9. doi: 10.1126/science.275.5306.1593.
The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.
预测未来事件的能力使生物能够检测、模拟并操控其与环境互动的因果结构。行为实验表明，学习是由对诸如奖励和惩罚等未来显著事件的期望变化所驱动的。最近，生理学研究通过在灵长类动物中识别多巴胺能神经元对这些研究进行了补充，这些神经元波动的输出显然标志着对未来显著和奖励事件预测的变化或错误。综合来看，这些发现可以通过自适应优化控制的定量理论来理解。
