Hayakawa Yoshihiro, Nakajima Koji
Department of Information Systems, Sendai National College of Technology, Sendai, Japan.
IEEE Trans Neural Netw. 2010 Feb;21(2):224-37. doi: 10.1109/TNN.2009.2035618. Epub 2009 Dec 11.
We have already proposed the inverse function delayed (ID) model as a novel neuron model. The ID model has a negative resistance similar to Bonhoeffer-van der Pol (BVP) model and the network has an energy function similar to Hopfield model. The neural network having an energy can converge on a solution of the combinatorial optimization problem and the computation is in parallel and hence fast. However, the existence of local minima is a serious problem. The negative resistance of the ID model can make the network state free from such local minima by selective destabilization. Hence, we expect that it has a potential to overcome the local minimum problems. In computer simulations, we have already shown that the ID network can be free from local minima and that it converges on the optimal solutions. However, the theoretical analysis has not been presented yet. In this paper, we redefine three types of constraints for the particular problems, then we analytically estimate the appropriate network parameters giving the global minimum states only. Moreover, we demonstrate the validity of estimated network parameters by computer simulations.
我们已经提出了逆函数延迟(ID)模型作为一种新型神经元模型。ID模型具有类似于邦霍费尔 - 范德波尔(BVP)模型的负电阻,并且该网络具有类似于霍普菲尔德模型的能量函数。具有能量的神经网络可以收敛到组合优化问题的一个解,并且计算是并行的,因此速度很快。然而,局部极小值的存在是一个严重问题。ID模型的负电阻可以通过选择性失稳使网络状态摆脱此类局部极小值。因此,我们期望它有潜力克服局部极小值问题。在计算机模拟中,我们已经表明ID网络可以摆脱局部极小值并且收敛到最优解。然而,尚未给出理论分析。在本文中,我们针对特定问题重新定义了三种类型的约束,然后通过分析估计仅给出全局最小状态的合适网络参数。此外,我们通过计算机模拟证明了估计的网络参数的有效性。