Institute on Aging, University of Florida College of Medicine, Gainesville, Florida, USA.
Department of Health Outcomes and Biomedical Informatics, University of Florida College of Medicine, Gainesville, Florida, USA.
J Gerontol A Biol Sci Med Sci. 2024 Sep 1;79(9). doi: 10.1093/gerona/glae184.
Chat Generative Pre-trained Transformer (ChatGPT) and other ChatBots have emerged as tools for interacting with information in manners resembling natural human speech. Consequently, the technology is used across various disciplines, including business, education, and even in biomedical sciences. There is a need to better understand how ChatGPT can be used to advance gerontology research. Therefore, we evaluated ChatGPT responses to questions on specific topics in gerontology research, and brainstormed recommendations for its use in the field.
We conducted semistructured brainstorming sessions to identify uses of ChatGPT in gerontology research. We divided a team of multidisciplinary researchers into 4 topical groups: (a) gero-clinical science, (b) basic geroscience, (c) informatics as it relates to electronic health records, and (d) gero-technology. Each group prompted ChatGPT on a theory-, methods-, and interpretation-based question and rated responses for accuracy and completeness based on standardized scales.
ChatGPT responses were rated by all groups as generally accurate. However, the completeness of responses was rated lower, except by members of the informatics group, who rated responses as highly comprehensive.
ChatGPT accurately depicts some major concepts in gerontological research. However, researchers have an important role in critically appraising the completeness of its responses. Having a single generalized resource like ChatGPT may help summarize the preponderance of evidence in the field to identify gaps in knowledge and promote cross-disciplinary collaboration.
聊天生成式预训练转换器(ChatGPT)和其他聊天机器人已经成为以类似于人类自然语言的方式与信息交互的工具。因此,这项技术被广泛应用于各个领域,包括商业、教育,甚至在生物医学科学中。需要更好地了解如何利用 ChatGPT 推进老年学研究。因此,我们评估了 ChatGPT 对老年学研究特定主题问题的回答,并集思广益,为其在该领域的应用提出建议。
我们进行了半结构化头脑风暴会议,以确定 ChatGPT 在老年学研究中的用途。我们将一组多学科研究人员分为 4 个专题小组:(a)老年临床科学,(b)基础老年科学,(c)与电子健康记录相关的信息学,以及(d)老年技术。每个小组都向 ChatGPT 提出了一个基于理论、方法和解释的问题,并根据标准化量表对回答的准确性和完整性进行评分。
所有小组都认为 ChatGPT 的回答通常是准确的。然而,回答的完整性评分较低,除了信息学小组的成员,他们对回答的综合程度评价较高。
ChatGPT 准确地描述了老年学研究中的一些主要概念。然而,研究人员在批判性地评价其回答的完整性方面发挥着重要作用。拥有像 ChatGPT 这样的单一通用资源可以帮助总结该领域的大部分证据,识别知识差距,并促进跨学科合作。