Lifespan Developmental Neuroscience, Faculty of Psychology, Technische Universität Dresden, 01062 Dresden, Germany
Methods of Psychology and Cognitive Modeling, Faculty of Psychology, Technische Universität Dresden, 01062 Dresden, Germany.
J Neurosci. 2023 Aug 30;43(35):6185-6196. doi: 10.1523/JNEUROSCI.2006-22.2023. Epub 2023 Aug 4.
Age-related impairments in value representations and updating during decision-making and reward-based learning are often related to age-related attenuation in the catecholamine system such as dopamine (DA) and norepinephrine (NE). However, it is unclear to what extent age-related declines in NE functioning in humans affect reward-based decision-making. We conducted a probabilistic decision-making task and applied a Q-learning model to investigate participants' anticipatory values and value sensitivities. Task-related pupil dilations and locus coeruleus (LC) magnetic resonance imaging (MRI) contrast, which served as a potential window of the LC-NE functions, were assessed in younger and older adults. Results showed that in both choice and feedback phases, younger adults' ( = 42, 22 males) pupil dilations negatively correlated with anticipatory values, indicating uncertainty about outcome probabilities. Uncertainty-evoked pupil dilations in older adults ( = 41, 27 males) were smaller, indicating age-related impairments in value estimation and updating. In both age groups, participants who showed a larger uncertainty-evoked pupil dilation exhibited a higher value sensitivity as reflected in the β parameter of the reinforcement Q-learning model. Furthermore, older adults ( = 34, 29 males) showed a lower LC-MRI contrast than younger adults ( = 25, 15 males). The LC-MRI contrast positively correlated with value sensitivity only in older but not in younger adults. These findings suggest that task-related pupillary responses can reflect age-related deficits in value estimation and updating during reward-based decision-making. Our evidence with the LC-MRI contrast further showed the age-related decline of the LC structure in modulating value representations during reward-based learning. Age-related impairments in value representation and updating during reward-based learning are associated with declines in the catecholamine modulation with age. However, it is unclear how age-related declines in the LC-NE system may affect reward-based learning. Here, we show that compared with younger adults, older adults exhibited reduced uncertainty-induced pupil dilations, suggesting age-related deficits in value estimation and updating. Older adults showed a lower structural MRI of the LC contrast than younger adults, indicating age-related degeneration of the LC structure. The association between the LC-MRI contrast and value sensitivity was only observed in older adults. Our findings may demonstrate a pioneering model to unravel the role of the LC-NE system in reward-based learning in aging.
年龄相关的价值表现和更新受损在决策和基于奖励的学习中很常见,这通常与儿茶酚胺系统(如多巴胺 (DA) 和去甲肾上腺素 (NE))的年龄相关衰减有关。然而,尚不清楚人类与年龄相关的去甲肾上腺素功能下降在多大程度上影响基于奖励的决策。我们进行了一项概率决策任务,并应用了 Q 学习模型来研究参与者的预期价值和价值敏感性。在年轻和年长的成年人中评估了与任务相关的瞳孔扩张和蓝斑(LC)磁共振成像(MRI)对比,这作为 LC-NE 功能的潜在窗口。结果表明,在选择和反馈阶段,年轻成年人(= 42,22 名男性)的瞳孔扩张与预期价值呈负相关,表明对结果概率的不确定性。年长成年人(= 41,27 名男性)的不确定诱发的瞳孔扩张较小,表明在价值估计和更新方面存在与年龄相关的损伤。在两个年龄组中,表现出更大不确定性诱发的瞳孔扩张的参与者表现出更高的价值敏感性,这反映在强化 Q 学习模型的β参数中。此外,年长成年人(= 34,29 名男性)的 LC-MRI 对比低于年轻成年人(= 25,15 名男性)。LC-MRI 对比仅与年长成年人(但与年轻成年人无关)的价值敏感性呈正相关。这些发现表明,与任务相关的瞳孔反应可以反映在基于奖励的决策中价值估计和更新方面的与年龄相关的缺陷。我们用 LC-MRI 对比的证据进一步表明,LC 结构的年龄相关下降会在基于奖励的学习中调节价值表现。在基于奖励的学习中,与年龄相关的价值表示和更新受损与儿茶酚胺调节的年龄相关下降有关。然而,尚不清楚 LC-NE 系统的年龄相关下降如何影响基于奖励的学习。在这里,我们表明与年轻成年人相比,年长成年人表现出减少的不确定性诱导的瞳孔扩张,表明在价值估计和更新方面存在与年龄相关的缺陷。年长成年人的 LC 结构磁共振对比低于年轻成年人,表明 LC 结构的年龄相关退化。LC-MRI 对比与价值敏感性之间的关联仅在年长成年人中观察到。我们的发现可能展示了一个开创性的模型,以揭示 LC-NE 系统在衰老中的基于奖励的学习中的作用。