ChatGPT与疫苗犹豫:使用经过验证的量表对英语、西班牙语和法语回应的比较

ChatGPT and Vaccine Hesitancy: A Comparison of English, Spanish, and French Responses Using a Validated Scale.

作者信息

Joshi Saubhagya, Ha Eunbin, Rivera Yonaira, Singh Vivek K

机构信息

School of Communication & Information Rutgers University, New Brunswick, NJ, USA.

出版信息

AMIA Jt Summits Transl Sci Proc. 2024 May 31;2024:266-275. eCollection 2024.

DOI:
Abstract

ChatGPT is a popular information system (over 1 billion visits in August 2023) that can generate natural language responses to user queries. It is important to study the quality and equity of its responses on health-related topics, such as vaccination, as they may influence public health decision-making. We use the Vaccine Hesitancy Scale (VHS) proposed by Shapiro et al. to measure the hesitancy of ChatGPT responses in English, Spanish, and French. We find that: (a) ChatGPT responses indicate less hesitancy than those reported for human respondents in past literature; (b) ChatGPT responses vary significantly across languages, with English responses being the most hesitant on average and Spanish being the least; (c) ChatGPT responses are largely consistent across different model parameters but show some variations across the scale factors (vaccine competency, risk). Results have implications for researchers interested in evaluating and improving the quality and equity of health-related web information.

摘要

ChatGPT是一个广受欢迎的信息系统(2023年8月访问量超过10亿次),它能够针对用户的提问生成自然语言回复。研究其在疫苗接种等健康相关主题上回复的质量和公平性非常重要,因为这些回复可能会影响公共卫生决策。我们使用夏皮罗等人提出的疫苗犹豫量表(VHS)来衡量ChatGPT在英语、西班牙语和法语中回复的犹豫程度。我们发现:(a)ChatGPT的回复显示出的犹豫程度低于过去文献中报道的人类受访者;(b)ChatGPT的回复在不同语言之间存在显著差异,平均而言,英语回复最为犹豫,西班牙语回复最不犹豫;(c)ChatGPT的回复在不同模型参数之间基本一致,但在量表因素(疫苗能力、风险)上存在一些差异。研究结果对有兴趣评估和改善健康相关网络信息的质量和公平性的研究人员具有启示意义。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索