Suppr超能文献

基于二维材料的概率型突触和可重构神经元,用于使用贝叶斯神经网络测量推理不确定性。

Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks.

机构信息

Deparment of Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA.

Department of Materials Science and Engineering, Penn State University, University Park, PA, 16802, USA.

出版信息

Nat Commun. 2022 Oct 17;13(1):6139. doi: 10.1038/s41467-022-33699-7.

Abstract

Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task.

摘要

人工神经网络在模式分类和学习等任务中表现出优于传统计算架构的优越性。然而,它们无法衡量预测中的不确定性,因此它们可以高度自信地做出错误的预测,这对于许多关键任务应用程序可能是有害的。相比之下,贝叶斯神经网络(BNN)自然会在其模型中包含这种不确定性,因为权重由概率分布(例如高斯分布)表示。在这里,我们介绍了基于二维(2D)材料的三端晶体管,它可以模拟概率突触和可重构神经元。通过利用 2D 晶体管编程过程中的循环到循环变化,实现了基于高斯随机数发生器的突触,而基于 2D 晶体管的集成电路则用于获得具有双曲正切和 sigmoid 激活函数的神经元。最后,基于晶体管的突触和神经元在交叉阵列架构中组合在一起,实现了用于数据分类任务的 BNN 加速器。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ec09/9576759/2cfa0dd10001/41467_2022_33699_Fig1_HTML.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验