Niu Chang, Zhang Huanyu, Xu Chuanlong, Hu Wenjie, Wu Yunzhuo, Wu Yu, Wang Yadi, Wu Tong, Zhu Yi, Zhu Yinyan, Wang Wenbin, Wu Yizheng, Yin Lifeng, Xiao Jiang, Yu Weichao, Guo Hangwen, Shen Jian
State Key Laboratory of Surface Physics and Institute for Nanoelectronic Devices and Quantum Computing, Fudan University, Shanghai 200433, China.
Department of Physics, Fudan University, Shanghai 200433, China.
Proc Natl Acad Sci U S A. 2024 Dec 17;121(51):e2416294121. doi: 10.1073/pnas.2416294121. Epub 2024 Dec 13.
Physical neural networks (PNN) using physical materials and devices to mimic synapses and neurons offer an energy-efficient way to implement artificial neural networks. Yet, training PNN is difficult and heavily relies on external computing resources. An emerging concept to solve this issue is called physical self-learning that uses intrinsic physical parameters as trainable weights. Under external inputs (i.e., training data), training is achieved by the natural evolution of physical parameters that intrinsically adapt modern learning rules via an autonomous physical process, eliminating the requirements on external computation resources. Here, we demonstrate a real spintronic system that mimics Hopfield neural networks (HNN), and unsupervised learning is intrinsically performed via the evolution of the physical process. Using magnetic texture-defined conductance matrix as trainable weights, we illustrate that under external voltage inputs, the conductance matrix naturally evolves and adapts Oja's learning algorithm in a gradient descent manner. The self-learning HNN is scalable and can achieve associative memories on patterns with high similarities. The fast spin dynamics and reconfigurability of magnetic textures offer an advantageous platform toward efficient autonomous training directly in materials.
使用物理材料和器件来模拟突触和神经元的物理神经网络(PNN)为实现人工神经网络提供了一种节能方式。然而,训练PNN很困难且严重依赖外部计算资源。一个解决该问题的新兴概念称为物理自学习,它使用固有物理参数作为可训练权重。在外部输入(即训练数据)下,通过物理参数的自然演化来实现训练,这些物理参数通过自主物理过程内在地适应现代学习规则,从而消除了对外部计算资源的需求。在此,我们展示了一个模拟霍普菲尔德神经网络(HNN)的真实自旋电子系统,并且无监督学习通过物理过程的演化内在地进行。使用由磁纹理定义的电导矩阵作为可训练权重,我们表明在外部电压输入下,电导矩阵自然演化并以梯度下降方式适应奥雅学习算法。自学习HNN具有可扩展性,并且可以在具有高度相似性的模式上实现关联记忆。磁纹理的快速自旋动力学和可重构性为直接在材料中进行高效自主训练提供了一个有利平台。