Weidler Tonio, Goebel Rainer, Senden Mario
Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.
Maastricht Brain Imaging Centre, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.
Front Neuroinform. 2023 Dec 22;17:1223687. doi: 10.3389/fninf.2023.1223687. eCollection 2023.
Goal-driven deep learning increasingly supplements classical modeling approaches in computational neuroscience. The strength of deep neural networks as models of the brain lies in their ability to autonomously learn the connectivity required to solve complex and ecologically valid tasks, obviating the need for hand-engineered or hypothesis-driven connectivity patterns. Consequently, goal-driven models can generate hypotheses about the neurocomputations underlying cortical processing that are grounded in macro- and mesoscopic anatomical properties of the network's biological counterpart. Whereas, goal-driven modeling is already becoming prevalent in the neuroscience of perception, its application to the sensorimotor domain is currently hampered by the complexity of the methods required to train models comprising the closed sensation-action loop. This paper describes , a Python library that mitigates this obstacle by providing researchers with the tools necessary to train complex recurrent convolutional neural networks that model the human sensorimotor system. To make the technical details of this toolkit more approachable, an illustrative example that trains a recurrent toy model on in-hand object manipulation accompanies the theoretical remarks. An extensive benchmark on various classical, 3D robotic, and anthropomorphic control tasks demonstrates AngoraPy's general applicability to a wide range of tasks. Together with its ability to adaptively handle custom architectures, the flexibility of this toolkit demonstrates its power for goal-driven sensorimotor modeling.
在计算神经科学中,目标驱动的深度学习越来越多地补充了经典建模方法。深度神经网络作为大脑模型的优势在于它们能够自主学习解决复杂且符合生态有效性任务所需的连接性,从而无需手工设计或假设驱动的连接模式。因此,目标驱动模型可以生成关于皮层处理背后神经计算的假设,这些假设基于网络生物学对应物的宏观和介观解剖学特性。然而,目标驱动建模在感知神经科学中已经变得很普遍,但其在感觉运动领域的应用目前受到训练包含封闭感觉 - 动作循环模型所需方法复杂性的阻碍。本文介绍了AngoraPy,这是一个Python库,通过为研究人员提供训练模拟人类感觉运动系统的复杂递归卷积神经网络所需的工具来缓解这一障碍。为了使这个工具包的技术细节更容易理解,在理论阐述之后给出了一个在手部物体操纵上训练递归玩具模型的示例。在各种经典、3D机器人和拟人控制任务上的广泛基准测试证明了AngoraPy对广泛任务的普遍适用性。连同其自适应处理自定义架构的能力,这个工具包的灵活性展示了其在目标驱动感觉运动建模方面的强大功能。