Mounier Eslam, Abdullah Bassem, Mahdi Hani, Eldawlatly Seif
Computer and Systems Engineering Department, Faculty of Engineering, Ain Shams University, 1 El-Sarayat St., Abbassia, Cairo, Egypt.
Faculty of Media Engineering and Technology, German University in Cairo, Cairo, Egypt.
Brain Inform. 2021 Jun 15;8(1):11. doi: 10.1186/s40708-021-00132-6.
The Lateral Geniculate Nucleus (LGN) represents one of the major processing sites along the visual pathway. Despite its crucial role in processing visual information and its utility as one target for recently developed visual prostheses, it is much less studied compared to the retina and the visual cortex. In this paper, we introduce a deep learning encoder to predict LGN neuronal firing in response to different visual stimulation patterns. The encoder comprises a deep Convolutional Neural Network (CNN) that incorporates visual stimulus spatiotemporal representation in addition to LGN neuronal firing history to predict the response of LGN neurons. Extracellular activity was recorded in vivo using multi-electrode arrays from single units in the LGN in 12 anesthetized rats with a total neuronal population of 150 units. Neural activity was recorded in response to single-pixel, checkerboard and geometrical shapes visual stimulation patterns. Extracted firing rates and the corresponding stimulation patterns were used to train the model. The performance of the model was assessed using different testing data sets and different firing rate windows. An overall mean correlation coefficient between the actual and the predicted firing rates of 0.57 and 0.7 was achieved for the 10 ms and the 50 ms firing rate windows, respectively. Results demonstrate that the model is robust to variability in the spatiotemporal properties of the recorded neurons outperforming other examined models including the state-of-the-art Generalized Linear Model (GLM). The results indicate the potential of deep convolutional neural networks as viable models of LGN firing.
外侧膝状体核(LGN)是视觉通路中的主要处理部位之一。尽管它在处理视觉信息方面起着关键作用,并且作为最近开发的视觉假体的一个目标具有实用性,但与视网膜和视觉皮层相比,对它的研究要少得多。在本文中,我们引入了一种深度学习编码器,以预测LGN神经元对不同视觉刺激模式的放电。该编码器包括一个深度卷积神经网络(CNN),它除了结合LGN神经元放电历史外,还纳入视觉刺激的时空表征,以预测LGN神经元的反应。使用多电极阵列在12只麻醉大鼠的LGN中对单个神经元进行体内细胞外活动记录,总共有150个神经元。记录了对单像素、棋盘格和几何形状视觉刺激模式的神经活动。提取的放电率和相应的刺激模式用于训练模型。使用不同的测试数据集和不同的放电率窗口评估模型的性能。对于10毫秒和50毫秒的放电率窗口,实际放电率与预测放电率之间的总体平均相关系数分别达到0.57和0.7。结果表明,该模型对于所记录神经元的时空特性变化具有鲁棒性,优于其他检查模型,包括最先进的广义线性模型(GLM)。结果表明深度卷积神经网络作为LGN放电的可行模型具有潜力。