ChatGPT在头颈科学写作中的应用：一则警示轶事。
ChatGPT in head and neck scientific writing: A precautionary anecdote.
作者信息
Wu Robin T, Dang Rushil R
机构信息
Department of Plastic and Reconstruction Surgery, Chang Gung Memorial Hospital, Linkou, Taiwan; Division of Plastic and Reconstructive Surgery, Department of Surgery, Stanford University Hospital, Stanford, CA, USA.
Department of Plastic and Reconstruction Surgery, Chang Gung Memorial Hospital, Linkou, Taiwan; Former fellow, Maxillofacial Oncology and Reconstructive Surgery, Department of Oral and Maxillofacial Surgery, Boston Medical Center, Boston, MA, USA.
出版信息
Am J Otolaryngol. 2023 Nov-Dec;44(6):103980. doi: 10.1016/j.amjoto.2023.103980. Epub 2023 Jul 6.
PURPOSE
To evaluate the accuracy of ChatGPT references in scientific writing relevant to head and neck surgery.
MATERIALS AND METHODS
Five commonly researched keywords relevant to head and neck surgery were selected (osteoradionecrosis of the jaws, oral cancer, adjuvant therapy for oral cancer, TORS, and free flap reconstruction in oral cancer). The AI chatbot was then asked to provide ten complete citations for each of the keywords. Two independent authors reviewed the results for accuracy and assigned each article a numerical score based on pre-selected criteria.
RESULTS
Among 50 total references provided by ChatGPT, only five (10 %) were found to have the correct title, journal, authors, year of publication, and DOI. Merely 14 % of the presented references had correct DOI. References regarding free flap reconstruction for oral cancer were the least accurate from all the five categories, with no correct DOI. Complete inter-rater agreement was noted while evaluating the citations.
CONCLUSION
Only 10 % of the articles provided by ChatGPT, relevant to head and neck surgery, were correct. A high degree of academic hallucination was noted.
目的
评估ChatGPT在头颈部外科相关科学写作中参考文献的准确性。
材料与方法
选择了五个与头颈部外科相关的常见研究关键词（颌骨放射性骨坏死、口腔癌、口腔癌辅助治疗、经口机器人手术以及口腔癌游离皮瓣重建）。然后要求人工智能聊天机器人为每个关键词提供十条完整的参考文献。两位独立作者审查结果的准确性，并根据预先选定的标准为每篇文章赋予一个数值分数。
结果
在ChatGPT提供的50条参考文献中，仅发现五条（10%）具有正确的标题、期刊、作者、出版年份和数字对象标识符（DOI）。所提供参考文献中只有14%具有正确的DOI。在所有五个类别中，关于口腔癌游离皮瓣重建的参考文献准确性最低，没有正确的DOI。在评估参考文献时，评分者间完全一致。
结论
ChatGPT提供的与头颈部外科相关的文章中只有10%是正确的。发现存在高度的学术幻觉。
Zotero 插件