Department of Psychology, Faculty of Life Sciences, Humboldt-Universität zu Berlin, Unter den Linden 6, 10099, Berlin, Germany.
Cluster of Excellence Science of Intelligence, Technische Universität Berlin, Berlin, Germany.
Sci Rep. 2023 Sep 26;13(1):16111. doi: 10.1038/s41598-023-42802-x.
High-quality AI-generated portraits ("deepfakes") are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological and neural measures of human face perception. Using EEG, we tracked participants' (N = 30) brain responses to real faces showing positive, neutral, and negative expressions, after being informed that they are either real or fake. Smiling faces marked as fake appeared less positive, as reflected in expression ratings, and induced slower evaluations. Whereas presumed real smiles elicited canonical emotion effects with differences relative to neutral faces in the P1 and N170 components (markers of early visual perception) and in the EPN component (indicative of reflexive emotional processing), presumed deepfake smiles showed none of these effects. Additionally, only smiles presumed as fake showed enhanced LPP activity compared to neutral faces, suggesting more effortful evaluation. Negative expressions induced typical emotion effects, whether considered real or fake. Our findings demonstrate a dampening effect on perceptual, emotional, and evaluative processing of presumed deepfake smiles, but not angry expressions, adding new specificity to the debate on the societal impact of AI-generated content.
高质量的人工智能生成的人像(“深度伪造”)越来越普遍。了解它们在感知者中引起的反应对于评估其对社会的影响至关重要。在这里,我们研究了被描绘的人是真实的还是深度伪造的这一信念对人类面孔感知的心理和神经测量的影响。我们使用 EEG,在告知参与者(N=30)他们看到的人脸是真实的还是伪造的之后,追踪他们对展示出积极、中性和消极表情的真实人脸的大脑反应。被标记为假的笑脸看起来不那么积极,这反映在表情评分中,并且评估速度较慢。而被认为是真实的微笑则引发了与中性面孔在 P1 和 N170 成分(早期视觉感知的标志物)以及 EPN 成分(表示反射性情绪处理)中差异的典型情绪效应,而被认为是深度伪造的微笑则没有表现出这些效应。此外,只有被认为是假的笑脸与中性面孔相比表现出增强的 LPP 活动,表明评估更加费力。无论是被认为是真实的还是假的,消极的表情都会引起典型的情绪效应。我们的研究结果表明,对被认为是深度伪造的笑脸的感知、情感和评估处理存在抑制效应,但对愤怒的表情没有这种效应,这为关于人工智能生成内容对社会影响的争论增添了新的特异性。