Suppr超能文献

迈向脉冲神经网络中决策的自由响应范式。

Toward a Free-Response Paradigm of Decision Making in Spiking Neural Networks.

作者信息

Zhu Zhichao, Qi Yang, Lu Wenlian, Wang Zhigang, Cao Lu, Feng Jianfeng

机构信息

Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China.

Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, 200433, China

出版信息

Neural Comput. 2025 Feb 14;37(3):481-521. doi: 10.1162/neco_a_01733.

Abstract

Spiking neural networks (SNNs) have attracted significant interest in the development of brain-inspired computing systems due to their energy efficiency and similarities to biological information processing. In contrast to continuous-valued artificial neural networks, which produce results in a single step, SNNs require multiple steps during inference to achieve a desired accuracy level, resulting in a burden in real-time response and energy efficiency. Inspired by the tradeoff between speed and accuracy in human and animal decision-making processes, which exhibit correlations among reaction times, task complexity, and decision confidence, an inquiry emerges regarding how an SNN model can benefit by implementing these attributes. Here, we introduce a theory of decision making in SNNs by untangling the interplay between signal and noise. Under this theory, we introduce a new learning objective that trains an SNN not only to make the correct decisions but also to shape its confidence. Numerical experiments demonstrate that SNNs trained in this way exhibit improved confidence expression, reduced trial-to-trial variability, and shorter latency to reach the desired accuracy. We then introduce a stopping policy that can stop inference in a way that further enhances the time efficiency of SNNs. The stopping time can serve as an indicator to whether a decision is correct, akin to the reaction time in animal behavior experiments. By integrating stochasticity into decision making, this study opens up new possibilities to explore the capabilities of SNNs and advance SNNs and their applications in complex decision-making scenarios where model performance is limited.

摘要

脉冲神经网络(SNNs)因其能量效率以及与生物信息处理的相似性,在受大脑启发的计算系统发展中引起了广泛关注。与在单个步骤中产生结果的连续值人工神经网络不同,SNNs在推理过程中需要多个步骤才能达到期望的精度水平,这给实时响应和能量效率带来了负担。受人类和动物决策过程中速度与准确性之间权衡的启发,这种权衡在反应时间、任务复杂性和决策信心之间表现出相关性,于是出现了一个问题,即SNN模型如何通过实现这些属性而受益。在此,我们通过梳理信号与噪声之间的相互作用,引入了一种SNNs决策理论。在该理论下,我们引入了一个新的学习目标,该目标不仅训练SNN做出正确决策,还塑造其决策信心。数值实验表明,以这种方式训练的SNNs表现出改进的信心表达、减少的试验间变异性以及达到期望精度的更短延迟。然后,我们引入了一种停止策略,该策略可以以进一步提高SNNs时间效率的方式停止推理。停止时间可以作为决策是否正确的指标,类似于动物行为实验中的反应时间。通过将随机性整合到决策中,本研究为探索SNNs的能力以及推进SNNs及其在模型性能有限的复杂决策场景中的应用开辟了新的可能性。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验