Janbesaraei Sherwin Nedaei, Rasanan Amir Hosein Hadian, Nejati Vahid, Rad Jamal Amani
Institute for Cognitive Sciences Studies (ICSS), Tehran, Iran.
Department of Psychology, University of Basel, Missionsstrasse 62A, 4055 Basel, Switzerland.
Comput Brain Behav. 2025;8(2):286-320. doi: 10.1007/s42113-024-00228-2. Epub 2024 Nov 7.
The Iowa gambling task (IGT) is widely used to study risky decision-making and learning from rewards and punishments. Although numerous cognitive models have been developed using reinforcement learning frameworks to investigate the processes underlying the IGT, no single model has consistently been identified as superior, largely due to the overlooked importance of model flexibility in capturing choice patterns. This study examines whether human reinforcement learning models adequately capture key experimental choice patterns observed in IGT data. Using simulation and parameter space partitioning (PSP) methods, we explored the parameter space of two recently introduced models-Outcome-Representation Learning and Value plus Sequential Exploration-alongside four traditional models. PSP, a global analysis method, investigates what patterns are relevant to the parameters' spaces of a model, thereby providing insights into model flexibility. The PSP study revealed varying potentials among candidate models to generate relevant choice patterns in IGT, suggesting that model selection may be dependent on the specific choice patterns present in a given dataset. We investigated central choice patterns and fitted all models by analyzing a comprehensive data pool ( = 1428) comprising 45 behavioral datasets from both healthy and clinical populations. Applying Akaike and Bayesian information criteria, we found that the Value plus Sequential Exploration model outperformed others due to its balanced potential to generate all experimentally observed choice patterns. These findings suggested that the search for a suitable IGT model may have reached its conclusion, emphasizing the importance of aligning a model's parameter space with experimentally observed choice patterns for achieving high accuracy in cognitive modeling.
爱荷华赌博任务(IGT)被广泛用于研究风险决策以及从奖励和惩罚中学习。尽管已经使用强化学习框架开发了许多认知模型来研究IGT背后的过程,但没有一个单一模型一直被认为是 superior,这主要是由于在捕捉选择模式时模型灵活性的重要性被忽视了。本研究考察了人类强化学习模型是否能充分捕捉IGT数据中观察到的关键实验选择模式。使用模拟和参数空间划分(PSP)方法,我们探索了两个最近引入的模型——结果表示学习和价值加顺序探索——以及四个传统模型的参数空间。PSP是一种全局分析方法,它研究哪些模式与模型的参数空间相关,从而深入了解模型的灵活性。PSP研究揭示了候选模型在IGT中生成相关选择模式的不同潜力,这表明模型选择可能取决于给定数据集中存在的特定选择模式。我们研究了核心选择模式,并通过分析一个包含来自健康和临床人群的45个行为数据集的综合数据池( = 1428)对所有模型进行了拟合。应用赤池和贝叶斯信息准则,我们发现价值加顺序探索模型表现优于其他模型,因为它在生成所有实验观察到的选择模式方面具有平衡的潜力。这些发现表明,寻找合适的IGT模型可能已经得出结论,强调了使模型的参数空间与实验观察到的选择模式相一致对于在认知建模中实现高精度的重要性。