J Exp Anal Behav. 1973 Jan;19(1):39-54. doi: 10.1901/jeab.1973.19-39.
Pecks by pigeons on a response key produced an ON state during which intermittent rewards were freely available, i.e., independently of responding. Pecks during the ON state caused it to remain ON. If no pecks occurred, the state changed to OFF-the key color changed-and rewards were not presented. The state remained OFF until the next response. Thus, responses controlled the state in the chamber but did not cause immediate reinforcement. Four dimensions of the schedule were varied: the rates of response-independent rewards during ON; the duration of ON produced by each peck; the pattern of rewards during ON; and the presence vs absence of exteroceptive cues during ON and OFF. The results showed that rates of responding were primarily controlled by the duration of ON produced by each response. When each response caused a long period of ON, pecks occurred infrequently; when each response caused a brief period of ON, pecks were frequent.
鸽子啄击反应键会产生一个“开”状态,在此状态下间歇性奖励是自由可得的,即与反应无关。啄击“开”状态会使其保持“开”状态。如果没有啄击发生,状态会变为“关”——键的颜色会改变——并且不会呈现奖励。状态保持“关”,直到下一次反应。因此,反应控制了腔室内的状态,但不会立即强化。该方案有四个维度发生变化:开状态下反应独立奖励的速度;每次啄击产生的开持续时间;开状态下奖励的模式;以及开和关状态下是否存在外部线索。结果表明,反应的速度主要由每次反应产生的开持续时间控制。当每次反应都导致较长的开持续时间时,啄击发生的频率较低;当每次反应都导致较短的开持续时间时,啄击发生的频率较高。