Deparment of Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA.
Department of Materials Science and Engineering, Penn State University, University Park, PA, 16802, USA.
Nat Commun. 2022 Oct 17;13(1):6139. doi: 10.1038/s41467-022-33699-7.
Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task.
人工神经网络在模式分类和学习等任务中表现出优于传统计算架构的优越性。然而,它们无法衡量预测中的不确定性,因此它们可以高度自信地做出错误的预测,这对于许多关键任务应用程序可能是有害的。相比之下,贝叶斯神经网络(BNN)自然会在其模型中包含这种不确定性,因为权重由概率分布(例如高斯分布)表示。在这里,我们介绍了基于二维(2D)材料的三端晶体管,它可以模拟概率突触和可重构神经元。通过利用 2D 晶体管编程过程中的循环到循环变化,实现了基于高斯随机数发生器的突触,而基于 2D 晶体管的集成电路则用于获得具有双曲正切和 sigmoid 激活函数的神经元。最后,基于晶体管的突触和神经元在交叉阵列架构中组合在一起,实现了用于数据分类任务的 BNN 加速器。