ChatGPT 在文本改写和降低抄袭方面的能力:描述性分析。

The Ability of ChatGPT in Paraphrasing Texts and Reducing Plagiarism: A Descriptive Analysis.

机构信息

Gastrointestinal and Liver Diseases Research Center, Guilan University of Medical Sciences, Rasht, Iran.

Department of Internal Medicine, Yale New Haven Health Bridgeport Hospital, Bridgeport, NY, United States.

出版信息

JMIR Med Educ. 2024 Jul 8;10:e53308. doi: 10.2196/53308.

Abstract

BACKGROUND

The introduction of ChatGPT by OpenAI has garnered significant attention. Among its capabilities, paraphrasing stands out.

OBJECTIVE

This study aims to investigate the satisfactory levels of plagiarism in the paraphrased text produced by this chatbot.

METHODS

Three texts of varying lengths were presented to ChatGPT. ChatGPT was then instructed to paraphrase the provided texts using five different prompts. In the subsequent stage of the study, the texts were divided into separate paragraphs, and ChatGPT was requested to paraphrase each paragraph individually. Lastly, in the third stage, ChatGPT was asked to paraphrase the texts it had previously generated.

RESULTS

The average plagiarism rate in the texts generated by ChatGPT was 45% (SD 10%). ChatGPT exhibited a substantial reduction in plagiarism for the provided texts (mean difference -0.51, 95% CI -0.54 to -0.48; P<.001). Furthermore, when comparing the second attempt with the initial attempt, a significant decrease in the plagiarism rate was observed (mean difference -0.06, 95% CI -0.08 to -0.03; P<.001). The number of paragraphs in the texts demonstrated a noteworthy association with the percentage of plagiarism, with texts consisting of a single paragraph exhibiting the lowest plagiarism rate (P<.001).

CONCLUSIONS

Although ChatGPT demonstrates a notable reduction of plagiarism within texts, the existing levels of plagiarism remain relatively high. This underscores a crucial caution for researchers when incorporating this chatbot into their work.

摘要

背景

OpenAI 推出的 ChatGPT 引起了广泛关注。它的能力之一是改写。

目的

本研究旨在调查这个聊天机器人生成的改写文本中的抄袭程度满意度。

方法

向 ChatGPT 呈现了三个不同长度的文本。然后,指示 ChatGPT 使用五个不同的提示来改写提供的文本。在研究的下一阶段,将文本分成单独的段落,并要求 ChatGPT 单独改写每个段落。最后,在第三阶段,要求 ChatGPT 改写它之前生成的文本。

结果

ChatGPT 生成的文本的平均抄袭率为 45%(SD 10%)。ChatGPT 对提供的文本表现出显著减少的抄袭(平均差异-0.51,95%置信区间-0.54 至-0.48;P<.001)。此外,与初始尝试相比,第二次尝试时抄袭率显著降低(平均差异-0.06,95%置信区间-0.08 至-0.03;P<.001)。文本中的段落数与抄袭率呈显著相关,包含单个段落的文本表现出最低的抄袭率(P<.001)。

结论

尽管 ChatGPT 在文本内显示出显著减少的抄袭,但现有的抄袭水平仍然相对较高。这突显出研究人员在将这个聊天机器人纳入其工作时需要谨慎。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e1ae/11250043/8c49a6fd682c/mededu-v10-e53308-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索