Donahoe J W, Burgos J E, Palmer D C
Department of Psychology, University of Massachusetts, Amherst 01003.
J Exp Anal Behav. 1993 Jul;60(1):17-40. doi: 10.1901/jeab.1993.60-17.
We describe a principle of reinforcement that draws upon experimental analyses of both behavior and the neurosciences. Some of the implications of this principle for the interpretation of behavior are explored using computer simulations of adaptive neural networks. The simulations indicate that a single reinforcement principle, implemented in a biologically plausible neural network, is competent to produce as its cumulative product networks that can mediate a substantial number of the phenomena generated by respondent and operant contingencies. These include acquisition, extinction, reacquisition, conditioned reinforcement, and stimulus-control phenomena such as blocking and stimulus discrimination. The characteristics of the environment-behavior relations selected by the action of reinforcement on the connectivity of the network are consistent with behavior-analytic formulations: Operants are not elicited but, instead, the network permits them to be guided by the environment. Moreover, the guidance of behavior is context dependent, with the pathways activated by a stimulus determined in part by what other stimuli are acting on the network at that moment. In keeping with a selectionist approach to complexity, the cumulative effects of relatively simple reinforcement processes give promise of simulating the complex behavior of living organisms when acting upon adaptive neural networks.
我们描述了一种强化原则,该原则借鉴了行为学和神经科学的实验分析。利用自适应神经网络的计算机模拟,探讨了这一原则对行为解释的一些影响。模拟结果表明,在一个具有生物学合理性的神经网络中实施的单一强化原则,能够产生作为其累积产物的网络,这些网络可以介导大量由应答性和操作性偶然事件产生的现象。这些现象包括习得、消退、再习得、条件强化以及诸如阻断和刺激辨别等刺激控制现象。强化作用于网络连接性所选择的环境 - 行为关系的特征与行为分析的表述一致:操作性行为不是被引发的,相反,网络允许它们由环境引导。此外,行为的引导依赖于情境,由刺激激活的通路部分取决于当时作用于网络的其他刺激。与对复杂性的选择主义方法一致,相对简单的强化过程的累积效应有望在作用于自适应神经网络时模拟生物体的复杂行为。