Department of Psychology, New York University, New York, NY 10003.
Department of Psychology, University of Amsterdam, 1001 NK Amsterdam, The Netherlands.
Proc Natl Acad Sci U S A. 2022 Jul 19;119(29):e2204529119. doi: 10.1073/pnas.2204529119. Epub 2022 Jul 12.
Humans increasingly rely on artificial intelligence (AI) for efficient and objective decision-making, yet there is increasing concern that algorithms used by modern AI systems produce discriminatory outputs, presumably because they are trained on data in which societal biases are embedded. As a consequence, their use by human decision makers may result in the propagation, rather than reduction, of existing disparities. To assess this hypothesis empirically, we tested the relation between societal gender inequality and algorithmic search output and then examined the effect of this output on human decision-making. First, in two multinational samples ( = 37, 52 countries), we found that greater nation-level gender inequality was associated with more male-dominated Google image search results for the gender-neutral keyword "person" (in a nation's dominant language), revealing a link between societal-level disparities and algorithmic output. Next, in a series of experiments with human participants ( = 395), we demonstrated that the gender disparity associated with high- vs. low-inequality algorithmic outputs guided the formation of gender-biased prototypes and influenced hiring decisions in novel scenarios. These findings support the hypothesis that societal-level gender inequality is recapitulated in internet search algorithms, which in turn can influence human decision makers to act in ways that reinforce these disparities.
人类越来越依赖人工智能(AI)进行高效和客观的决策,但越来越多的人担心现代 AI 系统使用的算法会产生歧视性的输出,大概是因为它们是在数据中训练出来的,这些数据中嵌入了社会偏见。因此,人类决策者的使用可能会导致现有差距的扩大,而不是缩小。为了从经验上验证这一假设,我们测试了社会性别不平等与算法搜索输出之间的关系,然后研究了这种输出对人类决策的影响。首先,在两个跨国样本(=37,52 个国家)中,我们发现,一个国家的性别不平等程度越高,其主流语言中“人”这个性别中立关键词的谷歌图像搜索结果就越男性化,这揭示了社会层面的差距与算法输出之间的联系。接下来,我们通过一系列有人类参与者参与的实验(=395)证明,高不平等算法输出与低不平等算法输出相关的性别差距,引导了性别偏见原型的形成,并影响了在新情景下的招聘决策。这些发现支持了这样一种假设,即社会层面的性别不平等在互联网搜索算法中得到了再现,而这些算法反过来又会影响人类决策者,使他们以强化这些差距的方式行事。