Xu Haojie, Wu Hongshuai, Huang Changwei
School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China.
Guangxi Key Laboratory of Multimedia Communications and Network Technology, Guangxi University, Nanning 530004, China.
Chaos. 2024 Dec 1;34(12). doi: 10.1063/5.0242023.
Despite the growing attention and research on the impact of Q-learning-based strategy updating on the evolution of cooperation, the joint role of individual learners and social learners in evolutionary games has seldom been considered. Here, we propose a value-driven social learning model that incorporates a shape parameter, β, to characterize the degree of radicalism or conservatism in social learning. Using the prisoner's dilemma game on a square lattice as a paradigm, our simulation results show that the cooperation level has a non-trivial dependence of β, density ρ, and dilemma strength b. We find that both β and ρ have nonmonotonic effects on cooperation; specifically, moderate levels of radicalism in social learning can facilitate cooperation remarkably, and when slightly conservative, can form a favorable cooperation region with the appropriate ρ. Moreover, we have demonstrated that social learners play a key role in the formation of network reciprocity, whereas individual learners play a dual role of support and exploitation. Our results reveal a critical balance between individual learning and social learning that can maximize cooperation and provide insights into understanding the collective behavior in multi-agent systems.
尽管基于Q学习的策略更新对合作演化的影响受到越来越多的关注和研究,但个体学习者和社会学习者在演化博弈中的联合作用却很少被考虑。在此,我们提出一种价值驱动的社会学习模型,该模型纳入一个形状参数β来表征社会学习中的激进或保守程度。以方格上的囚徒困境博弈作为范例,我们的模拟结果表明,合作水平对β、密度ρ和困境强度b具有非平凡的依赖性。我们发现β和ρ对合作都有非单调效应;具体而言,社会学习中适度的激进水平可显著促进合作,而略为保守时,可与适当的ρ形成有利的合作区域。此外,我们证明社会学习者在网络互惠的形成中起关键作用,而个体学习者则发挥支持和利用的双重作用。我们的结果揭示了个体学习和社会学习之间的关键平衡,这可以使合作最大化,并为理解多智能体系统中的集体行为提供见解。