Joubert Damien, Marcireau Alexandre, Ralph Nic, Jolley Andrew, van Schaik André, Cohen Gregory
International Centre for Neuromorphic Systems, The MARCS Institute for Brain, Behaviour, and Development, Western Sydney University, Kingswood, NSW, Australia.
Front Neurosci. 2021 Jul 27;15:702765. doi: 10.3389/fnins.2021.702765. eCollection 2021.
It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although there are clear opportunities to outperform conventional approaches in terms of power consumption and processing speed. As neuromorphic sensors generate sparse data at the focal plane itself, they are inherently energy-efficient, data-driven, and fast. In this work, we present an extended DVS pixel simulator for neuromorphic benchmarks which simplifies the latency and the noise models. In addition, to more closely model the behaviour of a real pixel, the readout circuitry is modelled, as this can strongly affect the time precision of events in complex scenes. Using a dynamic variant of the MNIST dataset as a benchmarking task, we use this simulator to explore how the latency of the sensor allows it to outperform conventional sensors in terms of sensing speed.
自首个神经形态动态视觉传感器(DVS)发明以来,已经过去了二十多年,随后人们基于广泛的应用设想制造了许多原型。尽管在功耗和处理速度方面有明显机会超越传统方法,但在准确性方面与最先进的神经网络竞争却很困难。由于神经形态传感器在焦平面本身生成稀疏数据,它们本质上具有高能效、数据驱动且速度快的特点。在这项工作中,我们提出了一种用于神经形态基准测试的扩展DVS像素模拟器,它简化了延迟和噪声模型。此外,为了更精确地模拟真实像素的行为,对读出电路进行了建模,因为这会强烈影响复杂场景中事件的时间精度。使用MNIST数据集的动态变体作为基准测试任务,我们使用这个模拟器来探索传感器的延迟如何使其在传感速度方面优于传统传感器。