Suppr超能文献

深度学习原子间势中的快速不确定性估计。

Fast uncertainty estimates in deep learning interatomic potentials.

机构信息

Harvard University, Cambridge, Massachusetts 02138, USA.

Robert Bosch Research and Technology Center, Cambridge, Massachusetts 02472, USA.

出版信息

J Chem Phys. 2023 Apr 28;158(16). doi: 10.1063/5.0136574.

Abstract

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and material properties. A common short-coming shared by current approaches, however, is that neural networks only give point estimates of their predictions and do not come with predictive uncertainties associated with these estimates. Existing uncertainty quantification efforts have primarily leveraged the standard deviation of predictions across an ensemble of independently trained neural networks. This incurs a large computational overhead in both training and prediction, resulting in order-of-magnitude more expensive predictions. Here, we propose a method to estimate the predictive uncertainty based on a single neural network without the need for an ensemble. This allows us to obtain uncertainty estimates with virtually no additional computational overhead over standard training and inference. We demonstrate that the quality of the uncertainty estimates matches those obtained from deep ensembles. We further examine the uncertainty estimates of our methods and deep ensembles across the configuration space of our test system and compare the uncertainties to the potential energy surface. Finally, we study the efficacy of the method in an active learning setting and find the results to match an ensemble-based strategy at order-of-magnitude reduced computational cost.

摘要

深度学习已成为一种有前途的范例,可以实现对分子和材料性质的高精度预测。然而,目前的方法都存在一个共同的缺点,即神经网络只能对其预测进行单点估计,而没有与其预测相关的预测不确定性。现有的不确定性量化工作主要利用了一组独立训练的神经网络中预测的标准差。这在训练和预测过程中都会带来很大的计算开销,导致预测成本增加了数量级。在这里,我们提出了一种基于单个神经网络而无需集合的预测不确定性估计方法。这使得我们可以在不增加标准训练和推理计算开销的情况下获得不确定性估计。我们证明了不确定性估计的质量与从深度集合中获得的质量相匹配。我们进一步检查了我们的方法和深度集合在测试系统的配置空间中的不确定性估计,并将不确定性与势能面进行了比较。最后,我们在主动学习环境中研究了该方法的效果,并发现其结果在计算成本降低了数量级的情况下与基于集合的策略相匹配。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验