Ng Jeremy Y, Maduranayagam Sharleen G, Suthakar Nirekah, Li Amy, Lokker Cynthia, Iorio Alfonso, Haynes R Brian, Moher David
Centre for Journalology, Methods Centre, Ottawa Hospital Research Institute, Ottawa, ON, Canada.
Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
Lancet Digit Health. 2025 Jan;7(1):e94-e102. doi: 10.1016/S2589-7500(24)00202-4. Epub 2024 Nov 15.
Chatbots are artificial intelligence (AI) programs designed to simulate conversations with humans that present opportunities and challenges in scientific research. Despite growing clarity from publishing organisations on the use of AI chatbots, researchers' perceptions remain less understood. In this international cross-sectional survey, we aimed to assess researchers' attitudes, familiarity, perceived benefits, and limitations related to AI chatbots. Our online survey was open from July 9 to Aug 11, 2023, with 61 560 corresponding authors identified from 122 323 articles indexed in PubMed. 2452 (4·0%) provided responses and 2165 (94·5%) of 2292 who met eligibility criteria completed the survey. 1161 (54·0%) of 2149 respondents were male and 959 (44·6%) were female. 1294 (60·5%) of 2138 respondents were familiar with AI chatbots, and 945 (44·5%) of 2125 had previously used AI chatbots in research. Only 244 (11·4%) of 2137 reported institutional training on AI tools, and 211 (9·9%) of 2131 noted institutional policies on AI chatbot use. Despite mixed opinions on the benefits, 1428 (69·7%) of 2048 expressed interest in further training. Although many valued AI chatbots for reducing administrative workload (1299 [66·9%] of 1941), there was insufficient understanding of the decision making process (1484 [77·2%] of 1923). Overall, this study highlights substantial interest in AI chatbots among researchers, but also points to the need for more formal training and clarity on their use.
聊天机器人是旨在模拟与人类对话的人工智能(AI)程序,这在科学研究中既带来了机遇,也带来了挑战。尽管出版机构对人工智能聊天机器人的使用越来越明确,但研究人员的看法仍不太为人所知。在这项国际横断面调查中,我们旨在评估研究人员对人工智能聊天机器人的态度、熟悉程度、感知到的益处和局限性。我们的在线调查于2023年7月9日至8月11日开放,从PubMed索引的122323篇文章中确定了61560名通讯作者。2452人(4.0%)提供了回复,在符合资格标准的2292人中,2165人(94.5%)完成了调查。2149名受访者中,1161人(54.0%)为男性,959人(44.6%)为女性。2138名受访者中,1294人(60.5%)熟悉人工智能聊天机器人,2125人中945人(44.5%)此前在研究中使用过人工智能聊天机器人。在2137人中,只有244人(11.4%)报告接受过机构关于人工智能工具的培训,在2131人中,211人(9.9%)提到了机构关于使用人工智能聊天机器人的政策。尽管对其益处看法不一,但在2048人中,1428人(69.7%)表示有兴趣接受进一步培训。尽管许多人重视人工智能聊天机器人能减少行政工作量(1941人中的1299人[66.9%]),但对决策过程的了解不足(1923人中的1484人[77.2%])。总体而言,这项研究凸显了研究人员对人工智能聊天机器人的浓厚兴趣,但也指出需要进行更正规的培训并明确其使用方法。