Department of Cognitive Sciences, University of California, Irvine, CA 92697.
Center for the Neurobiology of Learning and Memory, University of California, Irvine, CA 92697.
Proc Natl Acad Sci U S A. 2023 Mar 28;120(13):e2216524120. doi: 10.1073/pnas.2216524120. Epub 2023 Mar 24.
Patch foraging presents a sequential decision-making problem widely studied across organisms-stay with a current option or leave it in search of a better alternative? Behavioral ecology has identified an optimal strategy for these decisions, but, across species, foragers systematically deviate from it, staying too long with an option or "overharvesting" relative to this optimum. Despite the ubiquity of this behavior, the mechanism underlying it remains unclear and an object of extensive investigation. Here, we address this gap by approaching foraging as both a decision-making and learning problem. Specifically, we propose a model in which foragers 1) rationally infer the structure of their environment and 2) use their uncertainty over the inferred structure representation to adaptively discount future rewards. We find that overharvesting can emerge from this rational statistical inference and uncertainty adaptation process. In a patch-leaving task, we show that human participants adapt their foraging to the richness and dynamics of the environment in ways consistent with our model. These findings suggest that definitions of optimal foraging could be extended by considering how foragers reduce and adapt to uncertainty over representations of their environment.
补丁觅食提出了一个广泛存在于生物体中的序列决策问题——是留在当前选项上,还是离开它去寻找更好的替代方案?行为生态学已经为这些决策确定了一种最佳策略,但在不同物种中,觅食者会系统地偏离这种策略,对一个选项停留太久或“过度收获”,相对于这种最优策略。尽管这种行为普遍存在,但它的机制仍不清楚,是广泛研究的对象。在这里,我们将觅食作为一个决策和学习问题来解决这个差距。具体来说,我们提出了一个模型,其中觅食者 1)理性推断他们的环境结构,2)利用他们对推断的结构表示的不确定性来自适应地折扣未来的奖励。我们发现,过度收获可以从这种理性的统计推断和不确定性适应过程中产生。在一个离开补丁的任务中,我们表明人类参与者以与我们的模型一致的方式适应环境的丰富度和动态。这些发现表明,可以通过考虑觅食者如何减少和适应对环境表示的不确定性来扩展最优觅食的定义。