College of Computer Science and Electronic Engineering, Hunan University, Changsha, 410082, China; Greater Bay Area Institute for Innovation, Hunan University, Guangzhou, 511300, China.
College of Computer Science and Electronic Engineering, Hunan University, Changsha, 410082, China.
Neural Netw. 2024 Oct;178:106408. doi: 10.1016/j.neunet.2024.106408. Epub 2024 May 22.
Memristor and activation function are two important nonlinear factors of the memristive Hopfield neural network. The effects of different memristors on the dynamics of Hopfield neural networks have been studied by many researchers. However, less attention has been paid to the activation function. In this paper, we present a heterogeneous memristive Hopfield neural network with neurons using different activation functions. The activation functions include fixed activation functions and an adaptive activation function, where the adaptive activation function is based on a memristor. The theoretical and experimental study of the neural network's dynamics has been conducted using phase portraits, bifurcation diagrams, and Lyapunov exponents spectras. Numerical results show that complex dynamical behaviors such as multi-scroll chaos, transient chaos, state jumps and multi-type coexisting attractors can be observed in the heterogeneous memristive Hopfield neural network. In addition, the hardware implementation of memristive Hopfield neural network with adaptive activation function is designed and verified. The experimental results are in good agreement with those obtained using numerical simulations.
忆阻器和激活函数是忆阻型 Hopfield 神经网络的两个重要非线性因素。许多研究人员已经研究了不同忆阻器对 Hopfield 神经网络动力学的影响。然而,对激活函数的关注较少。在本文中,我们提出了一种具有不同激活函数的神经元的异构忆阻型 Hopfield 神经网络。激活函数包括固定激活函数和基于忆阻器的自适应激活函数。通过相图、分岔图和 Lyapunov 指数谱对神经网络的动力学进行了理论和实验研究。数值结果表明,在异构忆阻型 Hopfield 神经网络中可以观察到多涡卷混沌、暂态混沌、状态跳跃和多类型共存吸引子等复杂动力学行为。此外,设计并验证了具有自适应激活函数的忆阻型 Hopfield 神经网络的硬件实现。实验结果与数值模拟结果吻合较好。