Yang Chao, Wang Xiaoping, Chen Zhanfei, Zhang Sen, Zeng Zhigang
IEEE Trans Biomed Circuits Syst. 2022 Oct;16(5):926-938. doi: 10.1109/TBCAS.2022.3204742. Epub 2022 Nov 30.
Classical conditioning (CC) and operant conditioning (OC), also known as associative memory, are two of the most fundamental and critical learning mechanisms in the biological brain. However, the existing designs of associative memory memristive circuits mainly focus on CC, and few studies have used memristors to imitate OC at the behavioral level, as well as the OC-CC cascaded associative memories that are widespread in biological learning processes. This work proposes an OC-CC cascaded circuit composed of OC and CC circuits. With the OC memristive circuit, bio-like functions such as random exploration, feedback learning, experience memory, and experience-based decision-making are achieved, which enables the circuit to continuously reshape its own memories and actions to adapt to changing environments. By cascading it with the CC memristive circuit that has the functions of associative learning, forgetting, generalization, and differentiation, the OC-CC cascaded circuit implements richer associative memories and has stronger environmental adaptability. Finally, the proposed circuits can perform on-line in-situ learning and in-memory computing. This is a more brain-like processing method, which is different from the von Neumann architecture. The simulation results of the proposed circuits in PSPICE show that they can simulate the above functions and have advantages in power consumption and hardware overhead. This work provides a possible realization idea for large-scale bionic learning.
经典条件作用(CC)和操作条件作用(OC),也被称为联想记忆,是生物大脑中最基本和关键的两种学习机制。然而,现有的联想记忆忆阻器电路设计主要集中在经典条件作用上,很少有研究在行为层面使用忆阻器来模仿操作条件作用,以及在生物学习过程中广泛存在的操作条件作用-经典条件作用级联联想记忆。这项工作提出了一种由操作条件作用和经典条件作用电路组成的操作条件作用-经典条件作用级联电路。通过操作条件作用忆阻器电路,实现了诸如随机探索、反馈学习、经验记忆和基于经验的决策等类似生物的功能,这使得电路能够不断重塑自身的记忆和行为以适应不断变化的环境。通过将其与具有联想学习、遗忘、泛化和区分功能的经典条件作用忆阻器电路级联,操作条件作用-经典条件作用级联电路实现了更丰富的联想记忆,并具有更强的环境适应性。最后,所提出的电路能够进行在线原位学习和内存计算。这是一种更类似大脑的处理方法,不同于冯·诺依曼架构。所提出电路在PSPICE中的仿真结果表明,它们能够模拟上述功能,并且在功耗和硬件开销方面具有优势。这项工作为大规模仿生学习提供了一种可能的实现思路。