Wack Morgan, Ehrett Carl, Linvill Darren, Warren Patrick
IKMZ, University of Zurich, Andreasstrasse 15 CH-8050, Zurich, Switzerland.
Media Forensics Hub, Clemson University, 405 South Palmetto Blvd, Clemson, SC 29634, USA.
PNAS Nexus. 2025 Apr 1;4(4):pgaf083. doi: 10.1093/pnasnexus/pgaf083. eCollection 2025 Apr.
Can AI bolster state-backed propaganda campaigns, in practice? Growing use of AI and large language models has drawn attention to the potential for accompanying tools to be used by malevolent actors. Though recent laboratory and experimental evidence has substantiated these concerns in principle, the usefulness of AI tools in the production of propaganda campaigns has remained difficult to ascertain. Drawing on the adoption of generative-AI techniques by a state-affiliated propaganda site with ties to Russia, we test whether AI adoption enabled the website to amplify and enhance its production of disinformation. First, we find that the use of generative-AI tools facilitated the outlet's generation of larger quantities of disinformation. Second, we find that use of generative-AI coincided with shifts in the volume and breadth of published content. Finally, drawing on a survey experiment comparing perceptions of articles produced prior to and following the adoption of AI tools, we show that the AI-assisted articles maintained their persuasiveness in the postadoption period. Our results illustrate how generative-AI tools have already begun to alter the size and scope of state-backed propaganda campaigns.
在实际中,人工智能能助力政府支持的宣传活动吗?人工智能和大语言模型的使用日益增加,引发了人们对恶意行为者利用相关工具的可能性的关注。尽管最近的实验室和实验证据原则上证实了这些担忧,但人工智能工具在宣传活动制作中的作用仍难以确定。借助一个与俄罗斯有关联的政府附属宣传网站对生成式人工智能技术的采用情况,我们测试了采用人工智能是否使该网站能够扩大并提升其虚假信息的产出。首先,我们发现使用生成式人工智能工具促进了该媒体产出大量虚假信息。其次,我们发现使用生成式人工智能与发布内容的数量和广度的变化相吻合。最后,通过一项调查实验,比较对采用人工智能工具之前和之后所撰写文章的看法,我们表明,在采用人工智能之后,这些由人工智能辅助撰写的文章仍保持其说服力。我们的研究结果说明了生成式人工智能工具是如何已经开始改变政府支持的宣传活动的规模和范围的。