Petschenig Horst, Bisio Marta, Maschietto Marta, Leparulo Alessandro, Legenstein Robert, Vassanelli Stefano
Faculty of Computer Science and Biomedical Engineering, Institute of Theoretical Computer Science, Graz University of Technology, Graz, Austria.
NeuroChip Laboratory, Department of Biomedical Sciences, University of Padova, Padova, Italy.
Front Neurosci. 2022 Apr 14;16:838054. doi: 10.3389/fnins.2022.838054. eCollection 2022.
Spike-based neuromorphic hardware has great potential for low-energy brain-machine interfaces, leading to a novel paradigm for neuroprosthetics where spiking neurons in silicon read out and control activity of brain circuits. Neuromorphic processors can receive rich information about brain activity from both spikes and local field potentials (LFPs) recorded by implanted neural probes. However, it was unclear whether spiking neural networks (SNNs) implemented on such devices can effectively process that information. Here, we demonstrate that SNNs can be trained to classify whisker deflections of different amplitudes from evoked responses in a single barrel of the rat somatosensory cortex. We show that the classification performance is comparable or even superior to state-of-the-art machine learning approaches. We find that SNNs are rather insensitive to recorded signal type: both multi-unit spiking activity and LFPs yield similar results, where LFPs from cortical layers III and IV seem better suited than those of deep layers. In addition, no hand-crafted features need to be extracted from the data-multi-unit activity can directly be fed into these networks and a simple event-encoding of LFPs is sufficient for good performance. Furthermore, we find that the performance of SNNs is insensitive to the network state-their performance is similar during UP and DOWN states.
基于脉冲的神经形态硬件在低能耗脑机接口方面具有巨大潜力,从而为神经假体带来了一种新范式,即硅基脉冲神经元读出并控制脑回路的活动。神经形态处理器可以从植入式神经探针记录的脉冲和局部场电位(LFP)中接收有关脑活动的丰富信息。然而,尚不清楚在此类设备上实现的脉冲神经网络(SNN)是否能够有效地处理这些信息。在此,我们证明可以训练SNN对大鼠体感皮层单个桶状区域诱发反应中不同幅度的触须偏转进行分类。我们表明,分类性能与最先进的机器学习方法相当甚至更优。我们发现SNN对记录的信号类型相当不敏感:多单元脉冲活动和LFP都能产生相似的结果,其中来自皮层III层和IV层的LFP似乎比深层的LFP更适合。此外,无需从数据中提取手工特征——多单元活动可以直接输入这些网络,对LFP进行简单的事件编码就足以实现良好性能。此外,我们发现SNN的性能对网络状态不敏感——它们在UP状态和DOWN状态下的性能相似。