IEEE Trans Neural Netw Learn Syst. 2012 Sep;23(9):1426-35. doi: 10.1109/TNNLS.2012.2204770.
Analog hardware architecture of a memristor bridge synapse-based multilayer neural network and its learning scheme is proposed. The use of memristor bridge synapse in the proposed architecture solves one of the major problems, regarding nonvolatile weight storage in analog neural network implementations. To compensate for the spatial nonuniformity and nonideal response of the memristor bridge synapse, a modified chip-in-the-loop learning scheme suitable for the proposed neural network architecture is also proposed. In the proposed method, the initial learning is conducted in software, and the behavior of the software-trained network is learned by the hardware network by learning each of the single-layered neurons of the network independently. The forward calculation of the single-layered neuron learning is implemented on circuit hardware, and followed by a weight updating phase assisted by a host computer. Unlike conventional chip-in-the-loop learning, the need for the readout of synaptic weights for calculating weight updates in each epoch is eliminated by virtue of the memristor bridge synapse and the proposed learning scheme. The hardware architecture along with the successful implementation of proposed learning on a three-bit parity network, and on a car detection network is also presented.
提出了一种基于忆阻器桥突触的多层神经网络的模拟硬件架构及其学习方案。所提出架构中忆阻器桥突触的使用解决了模拟神经网络实现中关于非易失性权重存储的一个主要问题。为了补偿忆阻器桥突触的空间不均匀性和不理想的响应,还提出了一种适用于所提出的神经网络架构的改进的片上循环学习方案。在提出的方法中,初始学习在软件中进行,并且通过硬件网络学习网络的每个单独的单层神经元来学习软件训练的网络的行为。单层神经元学习的正向计算在电路硬件上实现,然后由主机辅助进行权重更新阶段。与传统的片上循环学习不同,由于忆阻器桥突触和所提出的学习方案,消除了在每个时期计算权重更新时读取突触权重的需要。还提出了硬件架构以及在三位奇偶网络和汽车检测网络上成功实现所提出的学习的情况。