Ran Huanhuan, Wen Shiping, Li Qian, Cao Yuting, Shi Kaibo, Huang Tingwen
IEEE Trans Neural Netw Learn Syst. 2023 Feb;34(2):987-998. doi: 10.1109/TNNLS.2021.3104860. Epub 2023 Feb 3.
As edge computing platforms need low power consumption and small volume circuit with artificial intelligence (AI), we design a compact and stable memristive visual geometry group (MVGG) neural network for image classification. According to characteristics of matrix-vector multiplication (MVM) using memristor crossbars, we design three pruning methods named row pruning, column pruning, and parameter distribution pruning. With a loss of only 0.41% of the classification accuracy, a pruning rate of 36.87% is obtained. In the MVGG circuit, both the batch normalization (BN) layers and dropout layers are combined into the memristive convolutional computing layer for decreasing the computing amount of the memristive neural network. In order to further reduce the influence of multistate conductance of memristors on classification accuracy of MVGG circuit, the layer optimization circuit and the channel optimization circuit are designed in this article. The theoretical analysis shows that the introduction of the optimized methods can greatly reduce the impact of the multistate conductance of memristors on the classification accuracy of MVGG circuits. Circuit simulation experiments show that, for the layer-optimized MVGG circuit, when the number of multistate conductance of memristors is 2 = 32 , the optimized circuit can basically achieve an accuracy of the full-precision MVGG. For the channel-optimized MVGG circuit, when the number of multistate conductance of memristors is 2 = 4 , the optimized circuit can basically achieve an accuracy of the full-precision MVGG.
由于边缘计算平台需要具备人工智能(AI)的低功耗和小体积电路,我们设计了一种用于图像分类的紧凑且稳定的忆阻视觉几何组(MVGG)神经网络。根据使用忆阻器交叉阵列的矩阵向量乘法(MVM)的特性,我们设计了三种剪枝方法,分别称为行剪枝、列剪枝和参数分布剪枝。在分类准确率仅损失0.41%的情况下,获得了36.87%的剪枝率。在MVGG电路中,批归一化(BN)层和随机失活层都被合并到忆阻卷积计算层中,以减少忆阻神经网络的计算量。为了进一步降低忆阻器的多态电导对MVGG电路分类准确率的影响,本文设计了层优化电路和通道优化电路。理论分析表明,引入优化方法可以大大降低忆阻器的多态电导对MVGG电路分类准确率的影响。电路仿真实验表明,对于层优化的MVGG电路,当忆阻器的多态电导数为2 = 32时,优化后的电路基本可以达到全精度MVGG的准确率。对于通道优化的MVGG电路,当忆阻器的多态电导数为2 = 4时,优化后的电路基本可以达到全精度MVGG的准确率。