利用 ChatGPT 评估癌症谣言和误解：人工智能与癌症信息。
Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information.
机构信息
Department of Radiation Oncology, University of Utah School of Medicine, Huntsman Cancer Institute, Salt Lake City, UT, USA.
Cancer Control and Population Sciences, Huntsman Cancer Institute, Salt Lake City, UT, USA.
出版信息
JNCI Cancer Spectr. 2023 Mar 1;7(2). doi: 10.1093/jncics/pkad015.
Data about the quality of cancer information that chatbots and other artificial intelligence systems provide are limited. Here, we evaluate the accuracy of cancer information on ChatGPT compared with the National Cancer Institute's (NCI's) answers by using the questions on the "Common Cancer Myths and Misconceptions" web page. The NCI's answers and ChatGPT answers to each question were blinded, and then evaluated for accuracy (accurate: yes vs no). Ratings were evaluated independently for each question, and then compared between the blinded NCI and ChatGPT answers. Additionally, word count and Flesch-Kincaid readability grade level for each individual response were evaluated. Following expert review, the percentage of overall agreement for accuracy was 100% for NCI answers and 96.9% for ChatGPT outputs for questions 1 through 13 (ĸ = ‒0.03, standard error = 0.08). There were few noticeable differences in the number of words or the readability of the answers from NCI or ChatGPT. Overall, the results suggest that ChatGPT provides accurate information about common cancer myths and misconceptions.
关于聊天机器人和其他人工智能系统提供的癌症信息质量的数据有限。在这里，我们通过使用“常见癌症误区和误解”网页上的问题来评估 ChatGPT 上的癌症信息与美国国家癌症研究所 (NCI) 答案的准确性。NCI 的答案和 ChatGPT 对每个问题的回答都是盲目的，然后根据准确性进行评估（准确：是/否）。每个问题的评分都是独立评估的，然后比较盲法 NCI 和 ChatGPT 答案之间的评分。此外，还评估了每个单独回复的字数和 Flesch-Kincaid 阅读水平等级。经过专家审查，NCI 答案的总体准确性百分比为 100%，ChatGPT 对问题 1 至 13 的回答的准确性百分比为 96.9%（k = -0.03，标准误差 = 0.08）。NCI 或 ChatGPT 的答案在字数或可读性方面几乎没有明显差异。总体而言，结果表明 ChatGPT 提供了有关常见癌症误区和误解的准确信息。
Zotero 插件