Suppr超能文献

具有Q学习路径的鲁尔科夫神经元网络中信号传输动力学的研究。

Investigation of Signal Transmission Dynamics in Rulkov Neuronal Networks with Q-Learned Pathways.

作者信息

Kobayashi Mio

机构信息

Institute of Humanities, Shinshu University, 3-1-1 Asahi, Matsumoto 390-8621, Nagano, Japan.

出版信息

Entropy (Basel). 2025 Aug 21;27(8):884. doi: 10.3390/e27080884.

Abstract

The dynamics of signal transmission in neuronal networks remain incompletely understood. In this study, we propose a novel Rulkov neuronal network model that incorporates Q-learning, a reinforcement learning method, to establish efficient signal transmission pathways. Using a simulated neuronal network, we focused on a key parameter that modulates both the intrinsic dynamics of individual neurons and the input signals received from active neighbors. We investigated how variations in this parameter affect signal transmission efficiency by analyzing changes in attenuation rate, as well as the maximum and minimum firing intervals of the start and goal neurons. Our simulations revealed that signal transmission efficiency between distant neurons was significantly impaired in the parameter region, where a chaotic attractor and an attractor of the eight-periodic points are observed to co-exist. A key finding was that low-frequency oscillatory bursts, while failing long-distance transmission, were capable of amplifying signals in neighboring neurons. Furthermore, we observed variation in signal transmission even when individual neuron dynamics remained similar. This variability, despite similar presynaptic activity, is a biologically significant phenomenon, and it is argued that it may contribute to the flexibility and robustness of information processing. These findings are discussed in the context of their biological implications.

摘要

神经网络中信号传输的动力学仍未被完全理解。在本研究中,我们提出了一种新颖的鲁尔科夫神经网络模型,该模型纳入了强化学习方法Q学习,以建立有效的信号传输途径。利用一个模拟的神经网络,我们聚焦于一个关键参数,该参数既调节单个神经元的内在动力学,又调节从活跃邻居接收到的输入信号。我们通过分析衰减率的变化以及起始神经元和目标神经元的最大和最小放电间隔,研究了该参数的变化如何影响信号传输效率。我们的模拟结果表明,在观察到混沌吸引子和八周期点吸引子共存的参数区域中,远距离神经元之间的信号传输效率显著受损。一个关键发现是,低频振荡脉冲串虽然无法进行长距离传输,但能够放大相邻神经元中的信号。此外,即使单个神经元动力学保持相似,我们也观察到了信号传输的变化。尽管突触前活动相似,但这种变异性是一种具有生物学意义的现象,有人认为它可能有助于信息处理的灵活性和稳健性。我们将在生物学意义的背景下讨论这些发现。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0c30/12385846/8626b2f06642/entropy-27-00884-g001.jpg

相似文献

6
Healthcare workers' informal uses of mobile phones and other mobile devices to support their work: a qualitative evidence synthesis.
Cochrane Database Syst Rev. 2024 Aug 27;8(8):CD015705. doi: 10.1002/14651858.CD015705.pub2.
8
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis.
Cochrane Database Syst Rev. 2021 Apr 19;4(4):CD011535. doi: 10.1002/14651858.CD011535.pub4.
9
Q-learning with temporal memory to navigate turbulence.
Elife. 2025 Jul 21;13:RP102906. doi: 10.7554/eLife.102906.
10
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis.
Cochrane Database Syst Rev. 2020 Jan 9;1(1):CD011535. doi: 10.1002/14651858.CD011535.pub3.

本文引用的文献

1
Exploring spiking neural networks for deep reinforcement learning in robotic tasks.
Sci Rep. 2024 Dec 28;14(1):30648. doi: 10.1038/s41598-024-77779-8.
3
Stochastic properties of neurotransmitter release expand the dynamic range of synapses.
J Neurosci. 2013 Sep 4;33(36):14406-16. doi: 10.1523/JNEUROSCI.2487-13.2013.
4
Neurophysiological and computational principles of cortical rhythms in cognition.
Physiol Rev. 2010 Jul;90(3):1195-268. doi: 10.1152/physrev.00035.2008.
5
Impulses and Physiological States in Theoretical Models of Nerve Membrane.
Biophys J. 1961 Jul;1(6):445-66. doi: 10.1016/s0006-3495(61)86902-6.
6
Simple model of spiking neurons.
IEEE Trans Neural Netw. 2003;14(6):1569-72. doi: 10.1109/TNN.2003.820440.
7
Synaptic plasticity: multiple forms, functions, and mechanisms.
Neuropsychopharmacology. 2008 Jan;33(1):18-41. doi: 10.1038/sj.npp.1301559. Epub 2007 Aug 29.
8
Dendritic protein synthesis, synaptic plasticity, and memory.
Cell. 2006 Oct 6;127(1):49-58. doi: 10.1016/j.cell.2006.09.014.
9
Oscillations in large-scale cortical networks: map-based model.
J Comput Neurosci. 2004 Sep-Oct;17(2):203-23. doi: 10.1023/B:JCNS.0000037683.55688.7e.
10
Modeling of spiking-bursting neural behavior using two-dimensional map.
Phys Rev E Stat Nonlin Soft Matter Phys. 2002 Apr;65(4 Pt 1):041922. doi: 10.1103/PhysRevE.65.041922. Epub 2002 Apr 10.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验