Ramírez Juan Camilo, Marshall James A R
Department of Biostatistics, School of Public Health, The University of Texas Health Science Center at Houston (UTHealth), Houston, Texas, USA.
Department of Computer Science, The University of Sheffield, Sheffield, UK. Electronic address: http://staffwww.dcs.shef.ac.uk/people/J.Marshall/.
J Theor Biol. 2017 Aug 7;426:57-66. doi: 10.1016/j.jtbi.2017.05.017. Epub 2017 May 20.
The evolutionary success of many organisms depends on their ability to make decisions based on estimates of the state of their environment (e.g., predation risk) from uncertain information. These decision problems have optimal solutions and individuals in nature are expected to evolve the behavioural mechanisms to make decisions as if using the optimal solutions. Bayesian inference is the optimal method to produce estimates from uncertain data, thus natural selection is expected to favour individuals with the behavioural mechanisms to make decisions as if they were computing Bayesian estimates in typically-experienced environments, although this does not necessarily imply that favoured decision-makers do perform Bayesian computations exactly. Each individual should evolve to behave as if updating a prior estimate of the unknown environment variable to a posterior estimate as it collects evidence. The prior estimate represents the decision-maker's default belief regarding the environment variable, i.e., the individual's default 'worldview' of the environment. This default belief has been hypothesised to be shaped by natural selection and represent the environment experienced by the individual's ancestors. We present an evolutionary model to explore how accurately Bayesian prior estimates can be encoded genetically and shaped by natural selection when decision-makers learn from uncertain information. The model simulates the evolution of a population of individuals that are required to estimate the probability of an event. Every individual has a prior estimate of this probability and collects noisy cues from the environment in order to update its prior belief to a Bayesian posterior estimate with the evidence gained. The prior is inherited and passed on to offspring. Fitness increases with the accuracy of the posterior estimates produced. Simulations show that prior estimates become accurate over evolutionary time. In addition to these 'Bayesian' individuals, we also introduce 'frequentist' individuals that do not use a prior and instead use frequentist inference when estimating the probability. Competition between the two shows that the former tend to have an evolutionary advantage over the latter, as predicted by the literature, and that this advantage is lowest when the information available to individuals poses the least uncertainty.
许多生物体在进化上的成功取决于它们根据不确定信息对环境状态(例如捕食风险)进行估计从而做出决策的能力。这些决策问题存在最优解,自然界中的个体有望进化出行为机制,以便像使用最优解一样做出决策。贝叶斯推理是从不确定数据中进行估计的最优方法,因此自然选择有望青睐具有行为机制的个体,使其在典型经历的环境中做出决策时就好像在计算贝叶斯估计值,尽管这并不一定意味着受青睐的决策者确实精确地进行了贝叶斯计算。每个个体都应进化得表现得好像在收集证据时将未知环境变量的先验估计更新为后验估计。先验估计代表决策者对环境变量的默认信念,即个体对环境的默认“世界观”。这种默认信念被假设是由自然选择塑造的,并代表个体祖先所经历的环境。我们提出一个进化模型,以探讨当决策者从不确定信息中学习时,贝叶斯先验估计能够在多大程度上通过基因编码并由自然选择塑造。该模型模拟了一群需要估计事件概率的个体的进化过程。每个个体对这个概率都有一个先验估计,并从环境中收集有噪声的线索,以便根据获得的证据将其先验信念更新为贝叶斯后验估计。先验是可遗传的,并传递给后代。适应度随着所产生的后验估计的准确性而增加。模拟结果表明,先验估计在进化过程中变得准确。除了这些“贝叶斯”个体,我们还引入了“频率主义”个体,它们在估计概率时不使用先验,而是使用频率主义推理。两者之间的竞争表明,正如文献所预测的那样,前者往往比后者具有进化优势,而且当个体可获得的信息所带来的不确定性最小时,这种优势最小。