Joghataie Abdolreza, Shafiei Dizaji Mehrdad
Structural Engineering Group, Sharif University of Technology, Tehran, Iran.
Hydraulic Structures Group, Sharif University of Technology, Tehran, Iran.
Neural Netw. 2016 Mar;75:77-83. doi: 10.1016/j.neunet.2015.11.010. Epub 2015 Dec 9.
In this paper, a learning algorithm is developed for Dynamic Plastic Continuous Neural Networks (DPCNNs) to improve their learning of highly nonlinear time dependent problems. A DPCNN is comprised of a base medium, which is nonlinear and plastic, and a number of neurons that are attached to the base by wire-like connections similar to perceptrons. The information is distributed within DPCNNs gradually and through wave propagation mechanism. While a DPCNN is adaptive due to its connection weights, the material properties of its base medium can also be adjusted to improve its learning. The material of the medium is plastic and can contribute to memorizing the history of input-response similar to neuroplasticity in natural brain. The results obtained from numerical simulation of DPCNNs have been encouraging. Nonlinear plastic finite element modeling has been used for numerical simulation of dynamic behavior and wave propagation in the medium. Two significant differences of DPCNNs with other types of neural networks are that: (1) there is a medium to which the neurons are attached where the medium can contribute to the learning, (2) the input layer is not made of nodes but it is an edge terminal which is capable of receiving a continuous function over the input edge, though it is discretized in the finite element model. A DPCNN is reduced to a perceptron if the medium is removed and the neurons are connected to each other only by wires. Continuity of the input lets the discretization of data take place intrinsically within the DPCNN instead of being applied by the user.
本文开发了一种用于动态塑性连续神经网络(DPCNN)的学习算法,以改进其对高度非线性时变问题的学习。一个DPCNN由一个非线性且具有塑性的基础介质以及一些通过类似于感知器的线状连接附着在该基础上的神经元组成。信息在DPCNN内通过波传播机制逐渐分布。虽然DPCNN因其连接权重而具有适应性,但其基础介质的材料特性也可进行调整以改善其学习能力。该介质的材料具有塑性,并且能够像自然大脑中的神经可塑性一样有助于记忆输入 - 响应的历史。从DPCNN的数值模拟中获得的结果令人鼓舞。非线性塑性有限元建模已用于介质中动态行为和波传播的数值模拟中。DPCNN与其他类型神经网络的两个显著区别在于:(1)存在一个附着神经元的介质,该介质有助于学习;(2)输入层不是由节点组成,而是一个边缘终端,它能够在输入边缘上接收连续函数,尽管在有限元模型中它是离散化的。如果去除介质且神经元仅通过导线相互连接,DPCNN就简化为一个感知器。输入的连续性使得数据离散化在DPCNN内部自然发生,而不是由用户进行应用。