Prescott Thomas P, Warne David J, Baker Ruth E
Alan Turing Institute, London NW1 2DB, United Kingdom.
Datasparq, 29 Clerkenwell Road, London EC1M 5RN, United Kingdom.
J Comput Phys. 2024 Jan;496:112577. doi: 10.1016/j.jcp.2023.112577.
Likelihood-free Bayesian inference algorithms are popular methods for inferring the parameters of complex stochastic models with intractable likelihoods. These algorithms characteristically rely heavily on repeated model simulations. However, whenever the computational cost of simulation is even moderately expensive, the significant burden incurred by likelihood-free algorithms leaves them infeasible for many practical applications. The multifidelity approach has been introduced in the context of approximate Bayesian computation to reduce the simulation burden of likelihood-free inference without loss of accuracy, by using the information provided by simulating computationally cheap, approximate models in place of the model of interest. In this work we demonstrate that multifidelity techniques can be applied in the general likelihood-free Bayesian inference setting. Analytical results on the optimal allocation of computational resources to simulations at different levels of fidelity are derived, and subsequently implemented practically. We provide an adaptive multifidelity likelihood-free inference algorithm that learns the relationships between models at different fidelities and adapts resource allocation accordingly, and demonstrate that this algorithm produces posterior estimates with near-optimal efficiency.
无似然贝叶斯推理算法是用于推断具有难以处理的似然性的复杂随机模型参数的常用方法。这些算法的特点是严重依赖于重复的模型模拟。然而,只要模拟的计算成本哪怕只是适度昂贵,无似然算法带来的巨大负担就会使其在许多实际应用中变得不可行。多保真度方法已在近似贝叶斯计算的背景下被引入,通过使用由计算成本低的近似模型模拟提供的信息来代替感兴趣的模型,从而在不损失准确性的情况下减轻无似然推理的模拟负担。在这项工作中,我们证明了多保真度技术可以应用于一般的无似然贝叶斯推理设置。推导了关于在不同保真度水平下对模拟进行计算资源最优分配的分析结果,并随后进行了实际实现。我们提供了一种自适应多保真度无似然推理算法,该算法学习不同保真度模型之间的关系并相应地调整资源分配,并证明该算法能以接近最优的效率产生后验估计。