Department of Pharmacology in Dentistry, Faculty of Dental Medicine, University of Belgrade, Belgrade, Serbia.
Int Dent J. 2024 Dec;74(6):1456-1462. doi: 10.1016/j.identj.2024.04.012. Epub 2024 Apr 26.
OBJECTIVES: The number of approvals for AI-based systems is increasing rapidly, although AI clinical trial designs lack consideration of the impact of human-AI interaction. Aim of this work was to investigate how reading of an AI system (ChatGPT) features/descriptions could influence the willingness and expectations for use of this technology as well as dental students' learning performance. METHODS: Dental students (N = 104) were asked to learn about side effects of drugs used in dental practice via reading recommended literature or ChatGPT. Expectations towards ChatGPT were measured by survey, before and after reading of a system features description, whilst learning outcomes were evaluated via pharmacology quiz. RESULTS: Students who used ChatGPT (YG group) showed better results on the pharmacology quiz than students who neither read the description nor employed ChatGPT for learning (NN condition). Moreover, students who read the description of ChatGPT features yet did not use it (NG) showed better results on the pharmacology quiz compared with the NN condition, although none of them employed ChatGPT for learning. The NG students compared to the YG students had less trust in AI system assistance in learning, and after the AI system description reading, their expectations changed significantly, showing an association with quiz scores. CONCLUSIONS: A majority of students in our cohort was reluctant to use ChatGPT. Furthermore, familarity (reading) with ChatGPT features appear to alter the expectations and enhance learning performance of students.suggesting an AI description-related cognitive bias. Hence the content description of ChatGPTshould be reviewed and verified prior to AI system use for educational purposes.
目的:尽管人工智能临床试验设计缺乏对人机交互影响的考虑,但基于人工智能的系统的批准数量正在迅速增加。本研究旨在探讨阅读人工智能系统(ChatGPT)的功能/描述如何影响人们对使用该技术的意愿和期望,以及牙科学生的学习表现。
方法:要求牙科学生(N=104)通过阅读推荐文献或 ChatGPT 来了解牙科实践中使用的药物的副作用。在阅读系统功能描述前后,通过问卷调查来测量学生对 ChatGPT 的期望,而学习成果则通过药理学测验来评估。
结果:使用 ChatGPT 的学生(YG 组)在药理学测验中的成绩优于既未阅读描述也未使用 ChatGPT 进行学习的学生(NN 条件)。此外,阅读了 ChatGPT 功能描述但未使用它的学生(NG 条件)在药理学测验中的成绩优于 NN 条件,尽管他们都没有使用 ChatGPT 进行学习。与 YG 学生相比,NG 学生对 AI 系统在学习中的辅助信任度较低,并且在阅读 AI 系统描述后,他们的期望发生了显著变化,这与测验分数有关。
结论:我们队列中的大多数学生都不愿意使用 ChatGPT。此外,熟悉(阅读)ChatGPT 功能似乎会改变学生的期望并提高他们的学习表现,这表明存在与 AI 描述相关的认知偏差。因此,在将 ChatGPT 用于教育目的之前,应审查和验证其内容描述。
Cogn Res Princ Implic. 2021-3-19