Cruz Nicolás C, González-Redondo Álvaro, Redondo Juana L, Garrido Jesús A, Ortigosa Eva M, Ortigosa Pilar M
Department of Computer Engineering, Automation and Robotics, University of Granada, Granada, Spain.
Department of Informatics, University of Almería, ceiA3 Excellence Agri-food Campus, Almeria, Spain.
Front Neuroinform. 2022 Oct 20;16:1017222. doi: 10.3389/fninf.2022.1017222. eCollection 2022.
The basal ganglia (BG) is a brain structure that has long been proposed to play an essential role in action selection, and theoretical models of spiking neurons have tried to explain how the BG solves this problem. A recently proposed functional and biologically inspired network model of the striatum (an important nucleus of the BG) is based on spike-timing-dependent eligibility (STDE) and captured important experimental features of this nucleus. The model can recognize complex input patterns and consistently choose rewarded actions to respond to such sensory inputs. However, model tuning is challenging due to two main reasons. The first is the expert knowledge required, resulting in tedious and potentially biased trial-and-error procedures. The second is the computational cost of assessing model configurations (approximately 1.78 h per evaluation). This study addresses the model tuning problem through numerical optimization. Considering the cost of assessing solutions, the selected methods stand out due to their low requirements for solution evaluations and compatibility with high-performance computing. They are the SurrogateOpt solver of Matlab and the RBFOpt library, both based on radial basis function approximations, and DIRECT-GL, an enhanced version of the widespread black-box optimizer DIRECT. Besides, a parallel random search serves as a baseline reference of the outcome of opting for sophisticated methods. SurrogateOpt turns out to be the best option for tuning this kind of model. It outperforms, on average, the quality of the configuration found by an expert and works significantly faster and autonomously. RBFOpt and the random search share the second position, but their average results are below the option found by hand. Finally, DIRECT-GL follows this line becoming the worst-performing method.
基底神经节(BG)是一种长期以来被认为在动作选择中起关键作用的脑结构,而脉冲神经元的理论模型一直试图解释BG是如何解决这一问题的。最近提出的一种基于脉冲时间依赖资格(STDE)的纹状体(BG的一个重要核团)功能和生物启发式网络模型,捕捉到了该核团的重要实验特征。该模型能够识别复杂的输入模式,并始终选择有奖励的动作来响应此类感觉输入。然而,由于两个主要原因,模型调优具有挑战性。第一个原因是需要专家知识,这导致了繁琐且可能有偏差的试错过程。第二个原因是评估模型配置的计算成本(每次评估约1.78小时)。本研究通过数值优化解决模型调优问题。考虑到评估解决方案的成本,所选方法因其对解决方案评估的低要求以及与高性能计算的兼容性而脱颖而出。它们是Matlab的SurrogateOpt求解器和RBFOpt库,两者都基于径向基函数近似,以及DIRECT - GL,一种广泛使用的黑箱优化器DIRECT的增强版本。此外,并行随机搜索作为选择复杂方法结果的基线参考。结果表明,SurrogateOpt是调整此类模型的最佳选择。它在平均水平上优于专家找到的配置质量,并且工作速度更快且能自主运行。RBFOpt和随机搜索并列第二,但它们的平均结果低于手动找到的选项。最后,DIRECT - GL排在最后,成为性能最差的方法。