Weilenmann Christoph, Ziogas Alexandros Nikolaos, Zellweger Till, Portner Kevin, Mladenović Marko, Kaniselvan Manasa, Moraitis Timoleon, Luisier Mathieu, Emboras Alexandros
Integrated Systems Laboratory, ETH Zurich, Zurich, Switzerland.
Noemon AG, Zurich, Switzerland.
Nat Commun. 2024 Aug 13;15(1):6898. doi: 10.1038/s41467-024-51093-3.
Biological neural networks do not only include long-term memory and weight multiplication capabilities, as commonly assumed in artificial neural networks, but also more complex functions such as short-term memory, short-term plasticity, and meta-plasticity - all collocated within each synapse. Here, we demonstrate memristive nano-devices based on SrTiO that inherently emulate all these synaptic functions. These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation. They can act as multi-functional hardware synapses in a class of bio-inspired deep neural networks (DNN) that make use of both long- and short-term synaptic dynamics and are capable of meta-learning or learning-to-learn. The resulting bio-inspired DNN is then trained to play the video game Atari Pong, a complex reinforcement learning task in a dynamic environment. Our analysis shows that the energy consumption of the DNN with multi-functional memristive synapses decreases by about two orders of magnitude as compared to a pure GPU implementation. Based on this finding, we infer that memristive devices with a better emulation of the synaptic functionalities do not only broaden the applicability of neuromorphic computing, but could also improve the performance and energy costs of certain artificial intelligence applications.
生物神经网络不仅包括长期记忆和权重乘法能力,这是人工神经网络中通常所假设的,还包括更复杂的功能,如短期记忆、短期可塑性和元可塑性——所有这些都分布在每个突触内。在这里,我们展示了基于SrTiO的忆阻纳米器件,其本质上可以模拟所有这些突触功能。这些忆阻器在非丝状、低电导状态下工作,这使得其能够稳定且高效地运行。它们可以在一类受生物启发的深度神经网络(DNN)中充当多功能硬件突触,这类网络利用了长期和短期突触动力学,并且能够进行元学习或学习如何学习。然后,对由此产生的受生物启发的DNN进行训练,使其玩电子游戏《雅达利乒乓球》,这是一个在动态环境中的复杂强化学习任务。我们的分析表明,与纯GPU实现相比,具有多功能忆阻突触的DNN的能耗降低了约两个数量级。基于这一发现,我们推断,能更好地模拟突触功能的忆阻器件不仅拓宽了神经形态计算的适用性,还可以提高某些人工智能应用的性能和能耗成本。