Smith Ryan, Friston Karl J, Whyte Christopher J
Laureate Institute for Brain Research, Tulsa, OK, USA.
Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, WC1N 3AR, UK.
J Math Psychol. 2022 Apr;107. doi: 10.1016/j.jmp.2021.102632. Epub 2022 Feb 4.
The active inference framework, and in particular its recent formulation as a partially observable Markov decision process (POMDP), has gained increasing popularity in recent years as a useful approach for modeling neurocognitive processes. This framework is highly general and flexible in its ability to be customized to model any cognitive process, as well as simulate predicted neuronal responses based on its accompanying neural process theory. It also affords both simulation experiments for proof of principle and behavioral modeling for empirical studies. However, there are limited resources that explain how to build and run these models in practice, which limits their widespread use. Most introductions assume a technical background in programming, mathematics, and machine learning. In this paper we offer a step-by-step tutorial on how to build POMDPs, run simulations using standard MATLAB routines, and fit these models to empirical data. We assume a minimal background in programming and mathematics, thoroughly explain all equations, and provide exemplar scripts that can be customized for both theoretical and empirical studies. Our goal is to provide the reader with the requisite background knowledge and practical tools to apply active inference to their own research. We also provide optional technical sections and multiple appendices, which offer the interested reader additional technical details. This tutorial should provide the reader with all the tools necessary to use these models and to follow emerging advances in active inference research.
主动推理框架,尤其是其最近作为部分可观测马尔可夫决策过程(POMDP)的形式,近年来作为一种用于模拟神经认知过程的有用方法越来越受欢迎。该框架具有高度的通用性和灵活性,能够针对任何认知过程进行定制建模,并基于其伴随的神经过程理论模拟预测的神经元反应。它还为原理验证提供了模拟实验,并为实证研究提供了行为建模。然而,在实际操作中解释如何构建和运行这些模型的资源有限,这限制了它们的广泛应用。大多数介绍都假定读者具有编程、数学和机器学习方面的技术背景。在本文中,我们提供了一个逐步教程,介绍如何构建POMDP、使用标准MATLAB程序运行模拟以及将这些模型拟合到实证数据。我们假定读者在编程和数学方面具有最低限度的背景知识,详尽解释所有方程,并提供可针对理论和实证研究进行定制的示例脚本。我们的目标是为读者提供必要的背景知识和实用工具,以便将主动推理应用于他们自己的研究。我们还提供了可选的技术章节和多个附录,为感兴趣的读者提供了更多技术细节。本教程应为读者提供使用这些模型以及跟进主动推理研究新进展所需的所有工具。