Lee Michael D, Webb Michael R
Department of Psychology, University of Adelaide, SA 5005, Australia.
Psychon Bull Rev. 2005 Aug;12(4):605-21. doi: 10.3758/bf03196751.
Many evaluations of cognitive models rely on data that have been averaged or aggregated across all experimental subjects, and so fail to consider the possibility of important individual differences between subjects. Other evaluations are done at the single-subject level, and so fail to benefit from the reduction of noise that data averaging or aggregation potentially provides. To overcome these weaknesses, we have developed a general approach to modeling individual differences using families of cognitive models in which different groups of subjects are identified as having different psychological behavior. Separate models with separate parameterizations are applied to each group of subjects, and Bayesian model selection is used to determine the appropriate number of groups. We evaluate this individual differences approach in a simulation study and show that it is superior in terms of the key modeling goals of prediction and understanding. We also provide two practical demonstrations of the approach, one using the ALCOVE model of category learning with data from four previously analyzed category learning experiments, the other using multidimensional scaling representational models with previously analyzed similarity data for colors. In both demonstrations, meaningful individual differences are found and the psychological models are able to account for this variation through interpretable differences in parameterization. The results highlight the potential of extending cognitive models to consider individual differences.
许多对认知模型的评估依赖于对所有实验对象的数据进行平均或汇总得到的数据,因此未能考虑到对象之间存在重要个体差异的可能性。其他评估是在单一个体层面进行的,因此未能从数据平均或汇总可能带来的噪声降低中获益。为了克服这些弱点,我们开发了一种通用方法,使用认知模型族对个体差异进行建模,其中不同组的对象被确定为具有不同的心理行为。针对每组对象应用具有单独参数化的单独模型,并使用贝叶斯模型选择来确定合适的组数。我们在一项模拟研究中评估了这种个体差异方法,并表明它在预测和理解等关键建模目标方面更具优势。我们还提供了该方法的两个实际示例,一个使用类别学习的ALCOVE模型和来自四个先前分析过的类别学习实验的数据,另一个使用多维缩放表征模型和先前分析过的颜色相似性数据。在这两个示例中,都发现了有意义的个体差异,并且心理模型能够通过参数化中可解释的差异来解释这种变化。结果凸显了扩展认知模型以考虑个体差异的潜力。