Suppr超能文献

寻找变时距程序的反馈函数。

In search of the feedback function for variable-interval schedules.

出版信息

J Exp Anal Behav. 1992 May;57(3):365-75. doi: 10.1901/jeab.1992.57-365.

Abstract

Finding a theoretically sound feedback function for variable-interval schedules remains an important unsolved problem. It is important because interval schedules model a significant feature of the world: the dependence of reinforcement on factors beyond the organism's control. The problem remains unsolved because no feedback function yet proposed satisfies all the theoretical and empirical requirements. Previous suggestions that succeed in fitting data fail theoretically because they violate a newly recognized theoretical requirement: The slope of the function must approach or equal 1.0 at the origin. A function is presented that satisfies all requirements but lacks any theoretical justification. This function and two suggested by Prelec and Herrnstein (1978) and Nevin and Baum (1980) are evaluated against several sets of data. All three fitted the data well. The success of the two theoretically incorrect functions raises an empirical puzzle: Low rates of reinforcement are coupled with response rates that seem anomalously high. It remains to be discovered what this reflects about the temporal patterning of operant behavior at low reinforcement rates. A theoretically and empirically correct function derived from basic assumptions about operant behavior also remains to be discovered.

摘要

为变时距程序找到一个理论上合理的反馈函数仍然是一个重要的未解决的问题。这很重要,因为间隔程序模型是世界的一个重要特征:强化取决于超出生物体控制的因素。这个问题仍然没有解决,因为迄今为止提出的没有一个反馈函数能够满足所有的理论和经验要求。以前那些成功拟合数据的建议在理论上是失败的,因为它们违反了一个新认识到的理论要求:该函数在原点处的斜率必须接近或等于 1.0。本文提出了一个满足所有要求但缺乏任何理论依据的函数。该函数和 Prelec 和 Herrnstein(1978)以及 Nevin 和 Baum(1980)提出的两个函数,都根据几组数据进行了评估。这三个函数都很好地拟合了数据。两个理论上不正确的函数的成功提出了一个经验上的难题:低强化率与反应率似乎异常高相关联。尚待发现这反映了低强化率下操作性行为的时间模式是什么。一个从操作性行为的基本假设中得出的理论上和经验上正确的函数也有待发现。

相似文献

1
In search of the feedback function for variable-interval schedules.
J Exp Anal Behav. 1992 May;57(3):365-75. doi: 10.1901/jeab.1992.57-365.
2
The effects of reinforcement frequency and response requirements on the maintenance of behavior.
J Exp Anal Behav. 1990 Jan;53(1):141-53. doi: 10.1901/jeab.1990.53-141.
4
Performances on ratio and interval schedules of reinforcement: Data and theory.
J Exp Anal Behav. 1993 Mar;59(2):245-64. doi: 10.1901/jeab.1993.59-245.
5
Extending unified-theory-of-reinforcement neural networks to steady-state operant behavior.
Behav Processes. 2016 Jun;127:52-61. doi: 10.1016/j.beproc.2016.03.016. Epub 2016 Mar 24.
8
The effect of punishment on free-operant choice behavior in humans.
J Exp Anal Behav. 1979 Jan;31(1):71-81. doi: 10.1901/jeab.1979.31-71.
9
Concurrent variable-interval variable-ratio schedules can provide only weak evidence for matching.
J Exp Anal Behav. 1984 Jan;41(1):83-100. doi: 10.1901/jeab.1984.41-83.
10

引用本文的文献

1
Effect of the reinforcement rate on goal-directed and habitual choices in a multiple schedule.
Front Psychol. 2025 Jul 2;16:1601901. doi: 10.3389/fpsyg.2025.1601901. eCollection 2025.
2
Explaining Performance on Interval and Ratio Schedules with a Molar View of Behavior.
Perspect Behav Sci. 2025 May 21;48(2):173-202. doi: 10.1007/s40614-025-00455-3. eCollection 2025 Jun.
3
Culturo-behavioral Hypercycles and the Metacontingency: Incorporating Self-Organizing Dynamics into an Expanded Model of Cultural Change.
Perspect Behav Sci. 2019 Jul 1;42(4):869-887. doi: 10.1007/s40614-019-00212-3. eCollection 2019 Dec.
4
A re-examination of responding on ratio and regulated-probability interval schedules.
Learn Motiv. 2018 Nov;64:1-8. doi: 10.1016/j.lmot.2018.07.003.
5
Temporal contingency.
Behav Processes. 2014 Jan;101:89-96. doi: 10.1016/j.beproc.2013.08.012. Epub 2013 Aug 29.
7
Experimental design: Problems in understanding the dynamical behavior-environment system.
Behav Anal. 1998 Fall;21(2):219-40. doi: 10.1007/BF03391965.
8
Concomitants, categories, and constraints.
Behav Anal. 1993 Spring;16(1):129-30. doi: 10.1007/BF03392618.
9
Rethinking reinforcement: allocation, induction, and contingency.
J Exp Anal Behav. 2012 Jan;97(1):101-24. doi: 10.1901/jeab.2012.97-101.
10
Rate, probability and matching: comments on "The identities hidden in the matching laws, and their uses" by David Thorne.
J Exp Anal Behav. 2010 Nov;94(3):365-7; discussion 369-72. doi: 10.1901/JEAB.2010.94-365.

本文引用的文献

1
Quasi-dynamic choice models: Melioration and ratio invariance.
J Exp Anal Behav. 1988 Mar;49(2):303-20. doi: 10.1901/jeab.1988.49-303.
2
Choice in transition: A comparison of melioration and the kinetic model.
J Exp Anal Behav. 1988 Mar;49(2):291-302. doi: 10.1901/jeab.1988.49-291.
3
Optimization and the matching law as accounts of instrumental behavior.
J Exp Anal Behav. 1981 Nov;36(3):387-403. doi: 10.1901/jeab.1981.36-387.
4
Feedback functions for variable-interval reinforcement.
J Exp Anal Behav. 1980 Sep;34(2):207-17. doi: 10.1901/jeab.1980.34-207.
5
A multivariate rate equation for variable-interval performance.
J Exp Anal Behav. 1979 Mar;31(2):267-83. doi: 10.1901/jeab.1979.31-267.
6
A molar theory of reinforcement schedules.
J Exp Anal Behav. 1978 Nov;30(3):345-60. doi: 10.1901/jeab.1978.30-345.
7
Time-based and count-based measurement of preference.
J Exp Anal Behav. 1976 Jul;26(1):27-35. doi: 10.1901/jeab.1976.26-27.
8
The correlation-based law of effect.
J Exp Anal Behav. 1973 Jul;20(1):137-53. doi: 10.1901/jeab.1973.20-137.
9
Effects of alternative reinforcement: does the source matter?
J Exp Anal Behav. 1972 Sep;18(2):231-41. doi: 10.1901/jeab.1972.18-231.
10
A two-state analysis of fixed-interval responding in the pigeon.
J Exp Anal Behav. 1969 Sep;12(5):677-87. doi: 10.1901/jeab.1969.12-677.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验