Eindhoven University of Technology, 5612 AP, Eindhoven, The Netherlands
Chalmers University of Technology, 41296, Gothenburg, Sweden
Neural Comput. 2021 Sep 16;33(10):2710-2735. doi: 10.1162/neco_a_01427.
Active inference (ActInf) is an emerging theory that explains perception and action in biological agents in terms of minimizing a free energy bound on Bayesian surprise. Goal-directed behavior is elicited by introducing prior beliefs on the underlying generative model. In contrast to prior beliefs, which constrain all realizations of a random variable, we propose an alternative approach through chance constraints, which allow for a (typically small) probability of constraint violation, and demonstrate how such constraints can be used as intrinsic drivers for goal-directed behavior in ActInf. We illustrate how chance-constrained ActInf weights all imposed (prior) constraints on the generative model, allowing, for example, for a trade-off between robust control and empirical chance constraint violation. Second, we interpret the proposed solution within a message passing framework. Interestingly, the message passing interpretation is not only relevant to the context of ActInf, but also provides a general-purpose approach that can account for chance constraints on graphical models. The chance constraint message updates can then be readily combined with other prederived message update rules without the need for custom derivations. The proposed chance-constrained message passing framework thus accelerates the search for workable models in general and can be used to complement message-passing formulations on generative neural models.
主动推理(ActInf)是一种新兴理论,它根据贝叶斯惊喜的自由能约束来解释生物主体的感知和行动。目标导向行为是通过引入关于潜在生成模型的先验信念来引出的。与先验信念不同,先验信念约束了随机变量的所有实现,我们通过机会约束提出了一种替代方法,这种方法允许约束违反的概率(通常很小),并展示了这种约束如何可以作为 ActInf 中目标导向行为的内在驱动力。我们说明了机会约束的 ActInf 如何对生成模型上施加的所有(先验)约束进行加权,例如,允许在鲁棒控制和经验机会约束违反之间进行权衡。其次,我们在消息传递框架内解释了所提出的解决方案。有趣的是,消息传递解释不仅与 ActInf 的上下文相关,而且还提供了一种通用方法,可以解释图形模型上的机会约束。然后可以轻松地将机会约束消息更新与其他预先推导的消息更新规则结合使用,而无需进行自定义推导。因此,所提出的机会约束消息传递框架加速了一般可行模型的搜索,并可用于补充生成神经模型上的消息传递公式。