• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

操作性条件作用的动力学

The dynamics of operant conditioning.

作者信息

Dragoi V, Staddon J E

机构信息

Department of Psychology, Duke University, USA.

出版信息

Psychol Rev. 1999 Jan;106(1):20-61. doi: 10.1037/0033-295x.106.1.20.

DOI:10.1037/0033-295x.106.1.20
PMID:10197362
Abstract

Existing models of operant learning are relatively insensitive to historical properties of behavior and applicable to only limited data sets. This article proposes a minimal set of principles based on short-term and long-term memory mechanisms that can explain the major static and dynamic properties of operant behavior in both single-choice and multiresponse situations. The critical features of the theory are as follows: (a) The key property of conditioning is assessment of the degree of association between responses and reinforcement and between stimuli and reinforcement; (b) the contingent reinforcement is represented by learning expectancy, which is the combined prediction of response-reinforcement and stimulus-reinforcement associations; (c) the operant response is controlled by the interplay between facilitatory and suppressive variables that integrate differences between expected (long-term) and experienced (short-term) events; and (d) very-long-term effects are encoded by a consolidated memory that is sensitive to the entire reinforcement history. The model predicts the major qualitative features of operant phenomena and then suggests an experimental test of theoretical predictions about the joint effects of reinforcement probability and amount of training on operant choice. We hypothesize that the set of elementary principles that we propose may help resolve the long-standing debate about the fundamental variables controlling operant conditioning.

摘要

现有的操作性学习模型对行为的历史特性相对不敏感,且仅适用于有限的数据集。本文基于短期和长期记忆机制提出了一组最小原则,这些原则能够解释在单选项和多反应情境中操作性行为的主要静态和动态特性。该理论的关键特征如下:(a)条件作用的关键特性是评估反应与强化之间以及刺激与强化之间的关联程度;(b)偶然强化由学习期望来表征,学习期望是反应-强化和刺激-强化关联的综合预测;(c)操作性反应由促进性和抑制性变量之间的相互作用控制,这些变量整合了预期(长期)和经历(短期)事件之间的差异;(d)非常长期的效应由对整个强化历史敏感的巩固记忆进行编码。该模型预测了操作性现象的主要定性特征,然后提出了一项关于强化概率和训练量对操作性选择的联合效应的理论预测的实验测试。我们假设,我们提出的这组基本原 则可能有助于解决关于控制操作性条件作用的基本变量的长期争论。

相似文献

1
The dynamics of operant conditioning.操作性条件作用的动力学
Psychol Rev. 1999 Jan;106(1):20-61. doi: 10.1037/0033-295x.106.1.20.
2
A Dynamic Theory of Acquisition and Extinction in Operant Learning.操作性学习中习得与消退的动态理论。
Neural Netw. 1997 Mar;10(2):201-229. doi: 10.1016/s0893-6080(96)00067-6.
3
Operant reward learning in Aplysia: neuronal correlates and mechanisms.海兔的操作性奖赏学习:神经元关联与机制
Science. 2002 May 31;296(5573):1706-9. doi: 10.1126/science.1069434.
4
Towards a mathematical model of within-session operant responding.
J Exp Psychol Anim Behav Process. 2012 Jul;38(3):292-302. doi: 10.1037/a0029086.
5
Operant conditioning of neural activity in freely behaving monkeys with intracranial reinforcement.通过颅内强化对自由活动猴子的神经活动进行操作性条件反射训练。
J Neurophysiol. 2017 Mar 1;117(3):1112-1125. doi: 10.1152/jn.00423.2016. Epub 2016 Dec 28.
6
A neural network model of adaptively timed reinforcement learning and hippocampal dynamics.一种自适应定时强化学习与海马体动力学的神经网络模型。
Brain Res Cogn Brain Res. 1992 Jun;1(1):3-38. doi: 10.1016/0926-6410(92)90003-a.
7
The conditioning of textual responses using "extrinsic" reinforcers.使用“外在”强化物对文本反应进行条件作用。
J Exp Anal Behav. 1962 Jan;5(1):33-40. doi: 10.1901/jeab.1962.5-33.
8
Elicited versus emitted behavior: Time to abandon the distinction.诱发行为与自发行为:是时候摒弃这种区分了。
J Exp Anal Behav. 2016 Mar;105(2):231-45. doi: 10.1002/jeab.197. Epub 2016 Feb 13.
9
Operant responding for conditioned and unconditioned reinforcers in rats is differentially enhanced by the primary reinforcing and reinforcement-enhancing effects of nicotine.尼古丁的主要强化作用和强化增强作用对大鼠为获得条件性和非条件性强化物而进行的操作性反应有不同程度的增强。
Psychopharmacology (Berl). 2006 Nov;189(1):27-36. doi: 10.1007/s00213-006-0522-0. Epub 2006 Sep 22.
10
Time and memory: towards a pacemaker-free theory of interval timing.时间与记忆:迈向无起搏器的间隔计时理论
J Exp Anal Behav. 1999 Mar;71(2):215-51. doi: 10.1901/jeab.1999.71-215.

引用本文的文献

1
The active time model of concurrent choice.并发选择的活动时间模型。
PLoS One. 2024 May 21;19(5):e0301173. doi: 10.1371/journal.pone.0301173. eCollection 2024.
2
The Critical Period After Stroke Study (CPASS) Upper Extremity Treatment Protocol.中风后关键期研究(CPASS)上肢治疗方案
Arch Rehabil Res Clin Transl. 2023 Jul 24;5(3):100282. doi: 10.1016/j.arrct.2023.100282. eCollection 2023 Sep.
3
Critical Period After Stroke Study (CPASS): A phase II clinical trial testing an optimal time for motor recovery after stroke in humans.
中风后关键期研究(CPASS):一项二期临床试验,旨在探索人类中风后运动康复的最佳时间。
Proc Natl Acad Sci U S A. 2021 Sep 28;118(39). doi: 10.1073/pnas.2026676118.
4
Enhancing the Effects of Neurofeedback Training: The Motivational Value of the Reinforcers.增强神经反馈训练的效果:强化物的动机价值。
Brain Sci. 2021 Apr 3;11(4):457. doi: 10.3390/brainsci11040457.
5
Psychophysical detection and learning in freely behaving rats: a probabilistic dynamical model for operant conditioning.自由活动大鼠的心理物理检测和学习:操作性条件反射的概率动力学模型。
J Comput Neurosci. 2020 Aug;48(3):333-353. doi: 10.1007/s10827-020-00751-8. Epub 2020 Jul 8.
6
Toward Increasing Engagement in Substance Use Data Collection: Development of the Substance Abuse Research Assistant App and Protocol for a Microrandomized Trial Using Adolescents and Emerging Adults.提高物质使用数据收集的参与度:物质滥用研究助手应用程序的开发以及一项针对青少年和新兴成年人的微随机试验方案
JMIR Res Protoc. 2018 Jul 18;7(7):e166. doi: 10.2196/resprot.9850.
7
Reinforcement of schedule-induced drinking in rats by lick-contingent shortening of food delivery.通过舔舐依赖的食物投放时间缩短来强化大鼠的日程诱导饮水行为。
Learn Behav. 2016 Dec;44(4):329-339. doi: 10.3758/s13420-016-0221-6.
8
Decision making about alcohol use: the case for scientific convergence.关于饮酒的决策:科学趋同的案例
Addict Behav. 2015 May;44:23-28. doi: 10.1016/j.addbeh.2014.12.001. Epub 2014 Dec 10.
9
Improving visual perception through neurofeedback.通过神经反馈改善视觉感知。
J Neurosci. 2012 Dec 5;32(49):17830-41. doi: 10.1523/JNEUROSCI.6334-11.2012.
10
The dynamics of the law of effect: a comparison of models.效果律的动态:模型比较。
J Exp Anal Behav. 2010 Jan;93(1):91-127. doi: 10.1901/jeab.2010.93-91.