Zhu Song, Yang Qiqi, Shen Yi
College of Sciences, China University of Mining and Technology, Xuzhou, 221116, China.
School of Automation, Huazhong University of Science and Technology, Wuhan, 430074, China.
Neural Netw. 2016 May;77:7-13. doi: 10.1016/j.neunet.2016.01.012. Epub 2016 Feb 21.
This paper shows that the globally exponentially stable neural network with time-varying delay and bounded noises may converge faster than those without noise. And the influence of noise on global exponential stability of DNNs was analyzed quantitatively. By comparing the upper bounds of noise intensity with coefficients of global exponential stability, we could deduce that noise is able to further express exponential decay for DNNs. The upper bounds of noise intensity are characterized by solving transcendental equations containing adjustable parameters. In addition, a numerical example is provided to illustrate the theoretical result.
本文表明,具有时变延迟和有界噪声的全局指数稳定神经网络可能比无噪声的神经网络收敛得更快。并且定量分析了噪声对深度神经网络全局指数稳定性的影响。通过比较噪声强度的上界与全局指数稳定性系数,我们可以推断出噪声能够进一步使深度神经网络呈现指数衰减。噪声强度的上界通过求解包含可调参数的超越方程来表征。此外,还给出了一个数值例子来说明理论结果。