Markowitz David M
Department of Communication, Michigan State University, East Lansing, MI 48824, USA.
PNAS Nexus. 2024 Sep 6;3(9):pgae387. doi: 10.1093/pnasnexus/pgae387. eCollection 2024 Sep.
This article evaluated the effectiveness of using generative AI to simplify science communication and enhance the public's understanding of science. By comparing lay summaries of journal articles from , yoked to those generated by AI, this work first assessed linguistic simplicity differences across such summaries and public perceptions in follow-up experiments. Specifically, study 1a analyzed simplicity features of abstracts (scientific summaries) and significance statements (lay summaries), observing that lay summaries were indeed linguistically simpler, but effect size differences were small. Study 1b used a large language model, GPT-4, to create significance statements based on paper abstracts and this more than doubled the average effect size without fine-tuning. Study 2 experimentally demonstrated that simply-written generative pre-trained transformer (GPT) summaries facilitated more favorable perceptions of scientists (they were perceived as more credible and trustworthy, but less intelligent) than more complexly written human summaries. Crucially, study 3 experimentally demonstrated that participants comprehended scientific writing better after reading simple GPT summaries compared to complex summaries. In their own words, participants also summarized scientific papers in a more detailed and concrete manner after reading GPT summaries compared to summaries of the same article. AI has the potential to engage scientific communities and the public via a simple language heuristic, advocating for its integration into scientific dissemination for a more informed society.
本文评估了使用生成式人工智能简化科学传播并增强公众对科学理解的有效性。通过比较来自……的期刊文章的外行摘要,并将其与人工智能生成的摘要进行匹配,这项工作首先在后续实验中评估了此类摘要在语言简洁性方面的差异以及公众认知。具体而言,研究1a分析了摘要(科学摘要)和重要性声明(外行摘要)的简洁性特征,观察到外行摘要在语言上确实更简洁,但效应量差异较小。研究1b使用大型语言模型GPT-4根据论文摘要创建重要性声明,在未经微调的情况下,这使平均效应量增加了一倍多。研究2通过实验证明,与撰写更为复杂的人类摘要相比,语言简洁的生成式预训练变换器(GPT)摘要能使人们对科学家产生更积极的看法(他们被认为更可信、更值得信赖,但不太聪明)。至关重要的是,研究3通过实验证明,与复杂摘要相比,参与者在阅读简单的GPT摘要后对科学写作的理解更好。用参与者自己的话说,与同一篇文章的人类摘要相比,他们在阅读GPT摘要后也能更详细、具体地总结科学论文。人工智能有潜力通过一种简单的语言启发式方法吸引科学界和公众,主张将其整合到科学传播中,以形成一个更有见识的社会。