• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

神经形态系统中的峰值基本运动检测器

Spiking Elementary Motion Detector in Neuromorphic Systems.

作者信息

Milde M B, Bertrand O J N, Ramachandran H, Egelhaaf M, Chicca E

机构信息

Institute of Neuroinformatics, University of Zurich, and ETH Zurich, 8057 Zurich, Switzerland

Neurobiology, Faculty of Biology, Bielefeld University, 33615 Bielefeld, and Cognitive Interaction Technology, Center of Excellence, Bielefeld University, 33501 Bielefeld, Germany

出版信息

Neural Comput. 2018 Sep;30(9):2384-2417. doi: 10.1162/neco_a_01112. Epub 2018 Jul 18.

DOI:10.1162/neco_a_01112
PMID:30021082
Abstract

Apparent motion of the surroundings on an agent's retina can be used to navigate through cluttered environments, avoid collisions with obstacles, or track targets of interest. The pattern of apparent motion of objects, (i.e., the optic flow), contains spatial information about the surrounding environment. For a small, fast-moving agent, as used in search and rescue missions, it is crucial to estimate the distance to close-by objects to avoid collisions quickly. This estimation cannot be done by conventional methods, such as frame-based optic flow estimation, given the size, power, and latency constraints of the necessary hardware. A practical alternative makes use of event-based vision sensors. Contrary to the frame-based approach, they produce so-called events only when there are changes in the visual scene. We propose a novel asynchronous circuit, the spiking elementary motion detector (sEMD), composed of a single silicon neuron and synapse, to detect elementary motion from an event-based vision sensor. The sEMD encodes the time an object's image needs to travel across the retina into a burst of spikes. The number of spikes within the burst is proportional to the speed of events across the retina. A fast but imprecise estimate of the time-to-travel can already be obtained from the first two spikes of a burst and refined by subsequent interspike intervals. The latter encoding scheme is possible due to an adaptive nonlinear synaptic efficacy scaling. We show that the sEMD can be used to compute a collision avoidance direction in the context of robotic navigation in a cluttered outdoor environment and compared the collision avoidance direction to a frame-based algorithm. The proposed computational principle constitutes a generic spiking temporal correlation detector that can be applied to other sensory modalities (e.g., sound localization), and it provides a novel perspective to gating information in spiking neural networks.

摘要

智能体视网膜上周围环境的表观运动可用于在杂乱环境中导航、避免与障碍物碰撞或跟踪感兴趣的目标。物体表观运动的模式(即光流)包含有关周围环境的空间信息。对于搜索和救援任务中使用的小型快速移动智能体而言,估计与附近物体的距离以快速避免碰撞至关重要。鉴于所需硬件的尺寸、功率和延迟限制,无法通过传统方法(如基于帧的光流估计)来进行这种估计。一种实用的替代方法是使用基于事件的视觉传感器。与基于帧的方法相反,它们仅在视觉场景发生变化时才产生所谓的事件。我们提出了一种新颖的异步电路,即脉冲基本运动检测器(sEMD),它由单个硅神经元和突触组成,用于从基于事件的视觉传感器检测基本运动。sEMD将物体图像穿过视网膜所需的时间编码为一串脉冲。脉冲串中的脉冲数量与事件在视网膜上的速度成正比。从脉冲串的前两个脉冲已经可以获得对行进时间的快速但不精确的估计,并通过后续的脉冲间隔进行细化。由于自适应非线性突触效能缩放,后一种编码方案是可行的。我们表明,sEMD可用于在杂乱的室外环境中的机器人导航背景下计算避撞方向,并将避撞方向与基于帧的算法进行比较。所提出的计算原理构成了一种通用的脉冲时间相关检测器,可应用于其他感官模态(如声音定位),并且它为脉冲神经网络中的门控信息提供了新的视角。

相似文献

1
Spiking Elementary Motion Detector in Neuromorphic Systems.神经形态系统中的峰值基本运动检测器
Neural Comput. 2018 Sep;30(9):2384-2417. doi: 10.1162/neco_a_01112. Epub 2018 Jul 18.
2
Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition.用于在线时空谱模式识别的动态进化尖峰神经网络。
Neural Netw. 2013 May;41:188-201. doi: 10.1016/j.neunet.2012.11.014. Epub 2012 Dec 20.
3
A Bio-inspired Collision Avoidance Model Based on Spatial Information Derived from Motion Detectors Leads to Common Routes.一种基于运动探测器空间信息的仿生避撞模型导致了共同路径。
PLoS Comput Biol. 2015 Nov 19;11(11):e1004339. doi: 10.1371/journal.pcbi.1004339. eCollection 2015 Nov.
4
What can neuromorphic event-driven precise timing add to spike-based pattern recognition?神经形态事件驱动的精确计时能为基于尖峰的模式识别增添什么?
Neural Comput. 2015 Mar;27(3):561-93. doi: 10.1162/NECO_a_00703. Epub 2015 Jan 20.
5
Shaping the collision selectivity in a looming sensitive neuron model with parallel ON and OFF pathways and spike frequency adaptation.具有并行 ON 和 OFF 通路和尖峰频率适应的逼近敏感神经元模型中的碰撞选择性塑造。
Neural Netw. 2018 Oct;106:127-143. doi: 10.1016/j.neunet.2018.04.001. Epub 2018 Apr 16.
6
Spike Burst Coding of Translatory Optic Flow and Depth from Motion in the Fly Visual System.从苍蝇视觉系统中的平移光流和运动深度推断出的尖峰突发编码。
Curr Biol. 2017 Nov 6;27(21):3225-3236.e3. doi: 10.1016/j.cub.2017.09.044. Epub 2017 Oct 19.
7
Simplified bionic solutions: a simple bio-inspired vehicle collision detection system.简化的仿生解决方案:一种简单的受生物启发的车辆碰撞检测系统。
Bioinspir Biomim. 2017 Feb 15;12(2):026007. doi: 10.1088/1748-3190/aa5993.
8
Movement-induced motion signal distributions in outdoor scenes.室外场景中运动诱导的运动信号分布。
Network. 2005 Dec;16(4):357-76. doi: 10.1080/09548980500497758.
9
Fidelity of the ensemble code for visual motion in primate retina.灵长类动物视网膜中视觉运动的整体编码保真度。
J Neurophysiol. 2005 Jul;94(1):119-35. doi: 10.1152/jn.01175.2004. Epub 2004 Dec 29.
10
Exploration of motion inhibition for the suppression of false positives in biologically inspired small target detection algorithms from a moving platform.从运动平台出发,探索运动抑制对生物启发型小目标检测算法中虚假阳性抑制的作用。
Biol Cybern. 2022 Dec;116(5-6):661-685. doi: 10.1007/s00422-022-00950-9. Epub 2022 Oct 28.

引用本文的文献

1
A neuromorphic electronic artist for robotic painting.一位用于机器人绘画的神经形态电子艺术家。
Sci Rep. 2025 Jun 4;15(1):19561. doi: 10.1038/s41598-025-92081-x.
2
SLoN: a spiking looming perception network exploiting neural encoding and processing in ON/OFF channels.SLoN:一种利用开/关通道中的神经编码和处理的脉冲逼近感知网络。
Front Neurosci. 2024 Mar 6;18:1291053. doi: 10.3389/fnins.2024.1291053. eCollection 2024.
3
Finding the gap: neuromorphic motion-vision in dense environments.寻找差距:密集环境中的神经形态运动视觉
Nat Commun. 2024 Jan 27;15(1):817. doi: 10.1038/s41467-024-45063-y.
4
Exploiting the PIR Sensor Analog Behavior as Thermoreceptor: Movement Direction Classification Based on Spiking Neurons.利用 PIR 传感器模拟行为作为热感受器:基于尖峰神经元的运动方向分类。
Sensors (Basel). 2023 Jun 22;23(13):5816. doi: 10.3390/s23135816.
5
Neuromorphic object localization using resistive memories and ultrasonic transducers.基于电阻式存储器和超声换能器的神经形态目标定位。
Nat Commun. 2022 Jun 18;13(1):3506. doi: 10.1038/s41467-022-31157-y.
6
Event-Based Computation for Touch Localization Based on Precise Spike Timing.基于精确脉冲时间的触摸定位的基于事件的计算
Front Neurosci. 2020 May 19;14:420. doi: 10.3389/fnins.2020.00420. eCollection 2020.
7
Event-Based Eccentric Motion Detection Exploiting Time Difference Encoding.基于事件的利用时间差编码的偏心运动检测
Front Neurosci. 2020 May 8;14:451. doi: 10.3389/fnins.2020.00451. eCollection 2020.