Linares-Barranco Alejandro, Liu Hongjie, Rios-Navarro Antonio, Gomez-Rodriguez Francisco, Moeys Diederik P, Delbruck Tobi
Robotic and Technology of Computers Lab, University of Seville, ES41012 Sevilla, Spain.
Institute of Neuroinformatics, ETHZ-UZH, CH8057 Zurich, Switzerland.
Entropy (Basel). 2018 Jun 19;20(6):475. doi: 10.3390/e20060475.
Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actuators. This paper is focused on mimicking the approaching detection functionality of the retina that is computed by one type of Retinal Ganglion Cell (RGC) and its application to robotics. These RGCs transmit action potentials when an expanding object is detected. In this work we compare the software and hardware logic FPGA implementations of this approaching function and the hardware latency when applied to robots, as an attention/reaction mechanism. The visual input for these cells comes from an asynchronous event-driven Dynamic Vision Sensor, which leads to an end-to-end event based processing system. The software model has been developed in Java, and computed with an average processing time per event of 370 ns on a NUC embedded computer. The output firing rate for an approaching object depends on the cell parameters that represent the needed number of input events to reach the firing threshold. For the hardware implementation, on a Spartan 6 FPGA, the processing time is reduced to 160 ns/event with the clock running at 50 MHz. The entropy has been calculated to demonstrate that the system is not totally deterministic in response to approaching objects because of several bioinspired characteristics. It has been measured that a Summit XL mobile robot can react to an approaching object in 90 ms, which can be used as an attentional mechanism. This is faster than similar event-based approaches in robotics and equivalent to human reaction latencies to visual stimulus.
从生物学中汲取灵感,利用生物神经计算的组织原则来解决工程问题,这是神经形态工程领域的目标。该领域已在基于传感器的应用(视觉和听觉)以及认知和致动器方面取得了成功。本文重点在于模仿由一种视网膜神经节细胞(RGC)计算出的视网膜接近检测功能及其在机器人技术中的应用。当检测到一个正在扩大的物体时,这些RGC会传输动作电位。在这项工作中,我们比较了这种接近功能的软件和硬件逻辑FPGA实现方式以及应用于机器人时的硬件延迟,将其作为一种注意力/反应机制。这些细胞的视觉输入来自一个异步事件驱动的动态视觉传感器,这导致了一个基于端到端事件的处理系统。软件模型是用Java开发的,在一台NUC嵌入式计算机上每个事件的平均处理时间为370纳秒。对于一个正在接近的物体,输出激发率取决于代表达到激发阈值所需输入事件数量的细胞参数。对于硬件实现,在一个Spartan 6 FPGA上,当时钟运行在50 MHz时,处理时间减少到了160纳秒/事件。已经计算了熵,以证明由于几个受生物启发的特性,该系统对接近物体的响应并非完全确定。据测量,一台Summit XL移动机器人能够在90毫秒内对一个接近的物体做出反应,这可以用作一种注意力机制。这比机器人技术中类似的基于事件的方法要快,并且与人类对视觉刺激的反应延迟相当。