文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

神经外科出版物中人工智能生成文本的流行情况:对学术诚信和道德署名的影响。

Prevalence of Artificial Intelligence-Generated Text in Neurosurgical Publications: Implications for Academic Integrity and Ethical Authorship.

作者信息

Schneider Daniel M, Mishra Akash, Gluski Jacob, Shah Harshal, Ward Max, Brown Ethan D, Sciubba Daniel M, Lo Sheng-Fu L

机构信息

Department of Neurosurgery, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Manhasset, USA.

出版信息

Cureus. 2025 Feb 16;17(2):e79086. doi: 10.7759/cureus.79086. eCollection 2025 Feb.


DOI:10.7759/cureus.79086
PMID:40109787
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11920854/
Abstract

INTRODUCTION: With the rapid proliferation of artificial intelligence (AI) tools, important questions about their applicability to manuscript preparation have been raised. This study explores the methodological challenges of detecting AI-generated content in neurosurgical publications, using existing detection tools to highlight both the presence of AI content and the fundamental limitations of current detection approaches. METHODS: We analyzed 100 randomly selected manuscripts published between 2023 and 2024 in high-impact neurosurgery journals using a two-tiered approach to identify potential AI-generated text. The text was classified as AI-generated if both a robustly optimized bidirectional encoder representations from transformers pretraining approach (RoBERTa)-based AI classification tool yielded a positive classification and the text's perplexity score was less than 100. Chi-square tests were conducted to assess differences in the prevalence of AI-generated text across various manuscript sections, topics, and types. In an effort to eliminate bias introduced by the more structured nature of abstracts, a subgroup analysis was conducted that excluded abstracts as well. RESULTS: Approximately one in five (20%) manuscripts contained sections flagged as AI-generated. Abstracts and methods sections were disproportionately identified. After excluding abstracts, the association between section type and AI-generated content was no longer statistically significant. CONCLUSION: Our findings highlight both the increasing integration of AI in manuscript preparation and a critical challenge in academic publishing as AI language models become increasingly sophisticated and traditional detection methods become less reliable. This suggests the need to shift focus from detection to transparency, emphasizing the development of clear disclosure policies and ethical guidelines for AI use in academic writing.

摘要

引言:随着人工智能(AI)工具的迅速普及,人们对其在稿件准备中的适用性提出了重要问题。本研究探讨了在神经外科出版物中检测人工智能生成内容的方法挑战,使用现有的检测工具来突出人工智能内容的存在以及当前检测方法的根本局限性。 方法:我们采用两级方法分析了2023年至2024年期间在高影响力神经外科期刊上随机选择的100篇手稿,以识别潜在的人工智能生成文本。如果基于强大优化的基于变换器预训练方法(RoBERTa)的人工智能分类工具给出阳性分类且文本的困惑度得分低于100,则将该文本分类为人工智能生成。进行卡方检验以评估不同手稿章节、主题和类型中人工智能生成文本的流行率差异。为了消除摘要更结构化性质所引入的偏差,还进行了一项排除摘要的亚组分析。 结果:约五分之一(20%)的手稿包含被标记为人工智能生成的章节。摘要和方法部分被过度识别。排除摘要后,章节类型与人工智能生成内容之间的关联不再具有统计学意义。 结论:我们的研究结果突出了人工智能在稿件准备中日益增加的整合以及学术出版中的一个关键挑战,因为人工智能语言模型变得越来越复杂,而传统检测方法变得越来越不可靠。这表明需要将重点从检测转向透明度,强调制定清晰的披露政策和学术写作中使用人工智能的道德准则。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/7c9447256467/cureus-0017-00000079086-i03.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/3fd9982d78d6/cureus-0017-00000079086-i01.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/4a47efaa4c57/cureus-0017-00000079086-i02.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/7c9447256467/cureus-0017-00000079086-i03.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/3fd9982d78d6/cureus-0017-00000079086-i01.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/4a47efaa4c57/cureus-0017-00000079086-i02.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6faa/11920854/7c9447256467/cureus-0017-00000079086-i03.jpg

相似文献

[1]
Prevalence of Artificial Intelligence-Generated Text in Neurosurgical Publications: Implications for Academic Integrity and Ethical Authorship.

Cureus. 2025-2-16

[2]
Detecting Artificial Intelligence-Generated Versus Human-Written Medical Student Essays: Semirandomized Controlled Study.

JMIR Med Educ. 2025-3-3

[3]
Rise of the Machines: The Prevalence and Disclosure of Artificial Intelligence-Generated Text in High-Impact Orthopaedic Journals.

J Am Acad Orthop Surg. 2024-10-1

[4]
AI-generated text in otolaryngology publications: a comparative analysis before and after the release of ChatGPT.

Eur Arch Otorhinolaryngol. 2024-11

[5]
Human vs machine: identifying ChatGPT-generated abstracts in Gynecology and Urogynecology.

Am J Obstet Gynecol. 2024-8

[6]
Ethical Dilemmas in Using AI for Academic Writing and an Example Framework for Peer Review in Nephrology Academia: A Narrative Review.

Clin Pract. 2023-12-30

[7]
Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora's Box Has Been Opened.

J Med Internet Res. 2023-5-31

[8]
Use of Artificial Intelligence in Scientific Writing.

Mymensingh Med J. 2025-4

[9]
Guiding principles and proposed classification system for the responsible adoption of artificial intelligence in scientific writing in medicine.

Front Artif Intell. 2023-11-16

[10]
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Cochrane Database Syst Rev. 2022-2-1

本文引用的文献

[1]
How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools.

Indian J Psychol Med. 2025-5

[2]
Navigating the complexities of artificial intelligence in scientific writing: a dual perspective.

Int J Gynecol Cancer. 2024-10-7

[3]
Characterizing the Increase in Artificial Intelligence Content Detection in Oncology Scientific Abstracts From 2021 to 2023.

JCO Clin Cancer Inform. 2024-5

[4]
Is ChatGPT corrupting peer review? Telltale words hint at AI use.

Nature. 2024-4

[5]
The ChatGPT conundrum: Human-generated scientific manuscripts misidentified as AI creations by AI text detection tool.

J Pathol Inform. 2023-10-17

[6]
Best Practices for Using AI Tools as an Author, Peer Reviewer, or Editor.

J Med Internet Res. 2023-8-31

[7]
ChatGPT: five priorities for research.

Nature. 2023-2

[8]
ChatGPT is fun, but not an author.

Science. 2023-1-27

[9]
The Global Research of Artificial Intelligence on Prostate Cancer: A 22-Year Bibliometric Analysis.

Front Oncol. 2022-3-1

[10]
Artificial Intelligence in Education (AIEd): a high-level academic and industry note 2021.

AI Ethics. 2022

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索