Suppr超能文献

人类强化学习模型是否考虑了爱荷华赌博任务中的关键实验选择模式?

Do Human Reinforcement Learning Models Account for Key Experimental Choice Patterns in the Iowa Gambling Task?

作者信息

Janbesaraei Sherwin Nedaei, Rasanan Amir Hosein Hadian, Nejati Vahid, Rad Jamal Amani

机构信息

Institute for Cognitive Sciences Studies (ICSS), Tehran, Iran.

Department of Psychology, University of Basel, Missionsstrasse 62A, 4055 Basel, Switzerland.

出版信息

Comput Brain Behav. 2025;8(2):286-320. doi: 10.1007/s42113-024-00228-2. Epub 2024 Nov 7.

Abstract

The Iowa gambling task (IGT) is widely used to study risky decision-making and learning from rewards and punishments. Although numerous cognitive models have been developed using reinforcement learning frameworks to investigate the processes underlying the IGT, no single model has consistently been identified as superior, largely due to the overlooked importance of model flexibility in capturing choice patterns. This study examines whether human reinforcement learning models adequately capture key experimental choice patterns observed in IGT data. Using simulation and parameter space partitioning (PSP) methods, we explored the parameter space of two recently introduced models-Outcome-Representation Learning and Value plus Sequential Exploration-alongside four traditional models. PSP, a global analysis method, investigates what patterns are relevant to the parameters' spaces of a model, thereby providing insights into model flexibility. The PSP study revealed varying potentials among candidate models to generate relevant choice patterns in IGT, suggesting that model selection may be dependent on the specific choice patterns present in a given dataset. We investigated central choice patterns and fitted all models by analyzing a comprehensive data pool ( = 1428) comprising 45 behavioral datasets from both healthy and clinical populations. Applying Akaike and Bayesian information criteria, we found that the Value plus Sequential Exploration model outperformed others due to its balanced potential to generate all experimentally observed choice patterns. These findings suggested that the search for a suitable IGT model may have reached its conclusion, emphasizing the importance of aligning a model's parameter space with experimentally observed choice patterns for achieving high accuracy in cognitive modeling.

摘要

爱荷华赌博任务(IGT)被广泛用于研究风险决策以及从奖励和惩罚中学习。尽管已经使用强化学习框架开发了许多认知模型来研究IGT背后的过程,但没有一个单一模型一直被认为是 superior,这主要是由于在捕捉选择模式时模型灵活性的重要性被忽视了。本研究考察了人类强化学习模型是否能充分捕捉IGT数据中观察到的关键实验选择模式。使用模拟和参数空间划分(PSP)方法,我们探索了两个最近引入的模型——结果表示学习和价值加顺序探索——以及四个传统模型的参数空间。PSP是一种全局分析方法,它研究哪些模式与模型的参数空间相关,从而深入了解模型的灵活性。PSP研究揭示了候选模型在IGT中生成相关选择模式的不同潜力,这表明模型选择可能取决于给定数据集中存在的特定选择模式。我们研究了核心选择模式,并通过分析一个包含来自健康和临床人群的45个行为数据集的综合数据池( = 1428)对所有模型进行了拟合。应用赤池和贝叶斯信息准则,我们发现价值加顺序探索模型表现优于其他模型,因为它在生成所有实验观察到的选择模式方面具有平衡的潜力。这些发现表明,寻找合适的IGT模型可能已经得出结论,强调了使模型的参数空间与实验观察到的选择模式相一致对于在认知建模中实现高精度的重要性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cba/12125058/36c6cd05382a/42113_2024_228_Fig1_HTML.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验