Harvard University, Cambridge, Massachusetts 02138, USA.
Robert Bosch Research and Technology Center, Cambridge, Massachusetts 02472, USA.
J Chem Phys. 2023 Apr 28;158(16). doi: 10.1063/5.0136574.
Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and material properties. A common short-coming shared by current approaches, however, is that neural networks only give point estimates of their predictions and do not come with predictive uncertainties associated with these estimates. Existing uncertainty quantification efforts have primarily leveraged the standard deviation of predictions across an ensemble of independently trained neural networks. This incurs a large computational overhead in both training and prediction, resulting in order-of-magnitude more expensive predictions. Here, we propose a method to estimate the predictive uncertainty based on a single neural network without the need for an ensemble. This allows us to obtain uncertainty estimates with virtually no additional computational overhead over standard training and inference. We demonstrate that the quality of the uncertainty estimates matches those obtained from deep ensembles. We further examine the uncertainty estimates of our methods and deep ensembles across the configuration space of our test system and compare the uncertainties to the potential energy surface. Finally, we study the efficacy of the method in an active learning setting and find the results to match an ensemble-based strategy at order-of-magnitude reduced computational cost.
深度学习已成为一种有前途的范例,可以实现对分子和材料性质的高精度预测。然而,目前的方法都存在一个共同的缺点,即神经网络只能对其预测进行单点估计,而没有与其预测相关的预测不确定性。现有的不确定性量化工作主要利用了一组独立训练的神经网络中预测的标准差。这在训练和预测过程中都会带来很大的计算开销,导致预测成本增加了数量级。在这里,我们提出了一种基于单个神经网络而无需集合的预测不确定性估计方法。这使得我们可以在不增加标准训练和推理计算开销的情况下获得不确定性估计。我们证明了不确定性估计的质量与从深度集合中获得的质量相匹配。我们进一步检查了我们的方法和深度集合在测试系统的配置空间中的不确定性估计,并将不确定性与势能面进行了比较。最后,我们在主动学习环境中研究了该方法的效果,并发现其结果在计算成本降低了数量级的情况下与基于集合的策略相匹配。