Suppr超能文献

A runs-test 算法:偶发强化与反应跑结构。

A runs-test algorithm: contingent reinforcement and response run structures.

机构信息

Department of Psychology, Keio University, 2-15-45, Mita, Minato-ku, Tokyo 108-8345, Japan.

出版信息

J Exp Anal Behav. 2010 Jan;93(1):61-80. doi: 10.1901/jeab.2010.93-61.

Abstract

Four rats' choices between two levers were differentially reinforced using a runs-test algorithm. On each trial, a runs-test score was calculated based on the last 20 choices. In Experiment 1, the onset of stimulus lights cued when the runs score was smaller than criterion. Following cuing, the correct choice was occasionally reinforced with food, and the incorrect choice resulted in a blackout. Results indicated that this contingency reduced sequential dependencies among successive choice responses. With one exception, subjects' choice rule was well described as biased coin flipping. In Experiment 2, cuing was removed and the reinforcement criterion was changed to a percentile score based on the last 20 reinforced responses. The results replicated those of Experiment 1 in successfully eliminating first-order dependencies in all subjects. For 2 subjects, choice allocation was approximately consistent with nonbiased coin flipping. These results suggest that sequential dependencies may be a function of reinforcement contingency.

摘要

四只老鼠通过运行测试算法对两个操纵杆进行了不同的强化选择。在每次试验中,根据最后 20 次选择计算一次运行测试得分。在实验 1 中,刺激灯的出现提示运行得分小于标准。提示后,正确的选择偶尔会得到食物强化,而错误的选择会导致黑屏。结果表明,这种条件作用减少了连续选择反应之间的序列依赖。除了一个例外,受试者的选择规则很好地描述为偏向硬币投掷。在实验 2 中,取消了提示,并将强化标准更改为基于最后 20 次强化反应的百分位数得分。结果成功地在所有受试者中消除了一阶依赖。对于 2 个受试者,选择分配与无偏硬币投掷大致一致。这些结果表明,序列依赖可能是强化条件作用的一个函数。

相似文献

1
A runs-test algorithm: contingent reinforcement and response run structures.
J Exp Anal Behav. 2010 Jan;93(1):61-80. doi: 10.1901/jeab.2010.93-61.
2
Preference pulses and the win-stay, fix-and-sample model of choice.
J Exp Anal Behav. 2015 Nov;104(3):274-95. doi: 10.1002/jeab.170. Epub 2015 Sep 29.
3
Observing responses and serial stimuli: searching for the reinforcing properties of the S-.
J Exp Anal Behav. 2009 Sep;92(2):215-31. doi: 10.1901/jeab.2009.92-215.
4
Preference pulses induced by reinforcement.
J Exp Anal Behav. 2014 Nov;102(3):335-45. doi: 10.1002/jeab.108. Epub 2014 Sep 30.
5
Effects of reinforcement schedules on rats' choice behavior in extinction.
J Gen Psychol. 1992 Apr;119(2):201-11. doi: 10.1080/00221309.1992.9921173.
7
Fix and sample with rats in the dynamics of choice.
J Exp Anal Behav. 2006 Jul;86(1):43-63. doi: 10.1901/jeab.2006.57-05.
8
Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts.
J Exp Anal Behav. 2020 Jul;114(1):47-59. doi: 10.1002/jeab.616. Epub 2020 Jul 8.
9
Choice and contingency in the development of behavioral autonomy during instrumental conditioning.
J Exp Psychol Anim Behav Process. 2010 Jul;36(3):334-42. doi: 10.1037/a0016887.
10
Effects of random reinforcement sequences.
J Exp Anal Behav. 1974 Sep;22(2):301-10. doi: 10.1901/jeab.1974.22-301.

引用本文的文献

本文引用的文献

1
Learning variable and stereotypical sequences of responses: Some data and a new model.
Behav Processes. 1993 Oct;30(2):103-29. doi: 10.1016/0376-6357(93)90002-9.
2
Functions of the environment in behavioral evolution.
Behav Anal. 1994 Fall;17(2):241-59. doi: 10.1007/BF03392674.
3
The effects of delayed reinforcement on variability and repetition of response sequences.
J Exp Anal Behav. 2006 Sep;86(2):159-79. doi: 10.1901/jeab.2006.58-05.
4
Operant variability when reinforcement is delayed.
Learn Behav. 2006 May;34(2):111-23. doi: 10.3758/bf03193187.
5
Differentiating the behavior of organisms.
J Exp Anal Behav. 1988 Sep;50(2):343-54. doi: 10.1901/jeab.1988.50-343.
6
The operant conditioning of response variability: Free-operant versus discrete-response procedures.
J Exp Anal Behav. 1987 May;47(3):273-7. doi: 10.1901/jeab.1987.47-273.
7
Variability of response location on fixed-ratio and fixed-interval schedules of reinforcement.
J Exp Anal Behav. 1978 Jul;30(1):63-7. doi: 10.1901/jeab.1978.30-63.
8
Concurrent responding with fixed relative rate of reinforcement.
J Exp Anal Behav. 1969 Nov;12(6):887-95. doi: 10.1901/jeab.1969.12-887.
9
The creative porpoise: training for novel behavior.
J Exp Anal Behav. 1969 Jul;12(4):653-61. doi: 10.1901/jeab.1969.12-653.
10
Reinforcement of least-frequent sequences of choices.
J Exp Anal Behav. 1967 Jan;10(1):57-65. doi: 10.1901/jeab.1967.10-57.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验