Morales Alejandro, Froese Tom
Embodied Cognitive Science Unit, Okinawa Institute of Science and Technology Graduate University, Okinawa, Japan.
Computer Science and Engineering Postgraduate Program, National Autonomous University of Mexico, Mexico City, Mexico.
Front Robot AI. 2020 Apr 2;7:40. doi: 10.3389/frobt.2020.00040. eCollection 2020.
Modeling of complex adaptive systems has revealed a still poorly understood benefit of unsupervised learning: when neural networks are enabled to form an associative memory of a large set of their own attractor configurations, they begin to reorganize their connectivity in a direction that minimizes the coordination constraints posed by the initial network architecture. This self-optimization process has been replicated in various neural network formalisms, but it is still unclear whether it can be applied to biologically more realistic network topologies and scaled up to larger networks. Here we continue our efforts to respond to these challenges by demonstrating the process on the connectome of the widely studied nematode worm . We extend our previous work by considering the contributions made by hierarchical partitions of the connectome that form functional clusters, and we explore possible beneficial effects of inter-cluster inhibitory connections. We conclude that the self-optimization process can be applied to neural network topologies characterized by greater biological realism, and that long-range inhibitory connections can facilitate the generalization capacity of the process.
当神经网络能够对大量自身吸引子配置形成关联记忆时,它们开始朝着最小化初始网络架构所带来的协调约束的方向重新组织其连接性。这个自我优化过程已在各种神经网络形式中得到复制,但仍不清楚它是否能应用于生物学上更现实的网络拓扑结构,并扩展到更大的网络。在这里,我们通过在广泛研究的线虫连接体上展示这一过程,继续努力应对这些挑战。我们通过考虑连接体分层划分形成功能簇所做的贡献来扩展我们之前的工作,并探索簇间抑制性连接可能产生的有益影响。我们得出结论,自我优化过程可以应用于具有更高生物学现实性的神经网络拓扑结构,并且长程抑制性连接可以促进该过程的泛化能力。