Suppr超能文献

医疗工作者对ChatGPT-3.5系统可用性量表的早期评估:在医疗实践中的应用前景

ChatGPT-3.5 System Usability Scale early assessment among Healthcare Workers: Horizons of adoption in medical practice.

作者信息

Aljamaan Fadi, Malki Khalid H, Alhasan Khalid, Jamal Amr, Altamimi Ibraheem, Khayat Afnan, Alhaboob Ali, Abdulmajeed Naif, Alshahrani Fatimah S, Saad Khaled, Al-Eyadhy Ayman, Al-Tawfiq Jaffar A, Temsah Mohamad-Hani

机构信息

College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.

Critical Care Department, College of Medicine, King Saud University, Riyadh 11362, Saudi Arabia.

出版信息

Heliyon. 2024 Apr 7;10(7):e28962. doi: 10.1016/j.heliyon.2024.e28962. eCollection 2024 Apr 15.

Abstract

Artificial intelligence (AI) chatbots, such as ChatGPT, have widely invaded all domains of human life. They have the potential to transform healthcare future. However, their effective implementation hinges on healthcare workers' (HCWs) adoption and perceptions. This study aimed to evaluate HCWs usability of ChatGPT three months post-launch in Saudi Arabia using the System Usability Scale (SUS). A total of 194 HCWs participated in the survey. Forty-seven percent were satisfied with their usage, 57 % expressed moderate to high trust in its ability to generate medical decisions. 58 % expected ChatGPT would improve patients' outcomes, even though 84 % were optimistic of its potential to improve the future of healthcare practice. They expressed possible concerns like recommending harmful medical decisions and medicolegal implications. The overall mean SUS score was 64.52, equivalent to 50 % percentile rank, indicating high marginal acceptability of the system. The strongest positive predictors of high SUS scores were participants' belief in AI chatbot's benefits in medical research, self-rated familiarity with ChatGPT and self-rated computer skills proficiency. Participants' learnability and ease of use score correlated positively but weakly. On the other hand, medical students and interns had significantly high learnability scores compared to others, while ease of use scores correlated very strongly with participants' perception of positive impact of ChatGPT on the future of healthcare practice. Our findings highlight the HCWs' perceived marginal acceptance of ChatGPT at the current stage and their optimism of its potential in supporting them in future practice, especially in the research domain, in addition to humble ambition of its potential to improve patients' outcomes particularly in regard of medical decisions. On the other end, it underscores the need for ongoing efforts to build trust and address ethical and legal concerns of AI implications in healthcare. The study contributes to the growing body of literature on AI chatbots in healthcare, especially addressing its future improvement strategies and provides insights for policymakers and healthcare providers about the potential benefits and challenges of implementing them in their practice.

摘要

诸如ChatGPT之类的人工智能聊天机器人已广泛侵入人类生活的各个领域。它们有潜力改变未来医疗保健。然而,它们的有效实施取决于医护人员的采用情况和看法。本研究旨在使用系统可用性量表(SUS)评估沙特阿拉伯推出ChatGPT三个月后医护人员对其的可用性。共有194名医护人员参与了调查。47%的人对其使用感到满意,57%的人对其生成医疗决策的能力表示中度到高度信任。58%的人期望ChatGPT能改善患者的治疗结果,尽管84%的人对其改善未来医疗实践的潜力持乐观态度。他们表达了可能的担忧,如推荐有害的医疗决策和法医学影响。SUS的总体平均得分为64.52,相当于第50百分位排名,表明该系统具有较高的边际可接受性。SUS高分的最强积极预测因素是参与者相信人工智能聊天机器人在医学研究中的益处、自我评定的对ChatGPT的熟悉程度以及自我评定的计算机技能熟练程度。参与者的易学性和易用性得分呈正相关但较弱。另一方面,与其他人相比,医学生和实习生的易学性得分显著较高,而易用性得分与参与者对ChatGPT对未来医疗实践的积极影响的看法密切相关。我们的研究结果突出了医护人员在现阶段对ChatGPT的边际接受度,以及他们对其在未来实践中支持他们的潜力的乐观态度,特别是在研究领域,此外还对其改善患者治疗结果的潜力抱有适度期望,特别是在医疗决策方面。另一方面,它强调了需要持续努力建立信任,并解决人工智能在医疗保健中的伦理和法律问题。该研究为医疗保健领域中关于人工智能聊天机器人的不断增长的文献做出了贡献,特别是探讨了其未来改进策略,并为政策制定者和医疗保健提供者提供了关于在实践中实施它们的潜在益处和挑战的见解。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/08e6/11016609/fde1b6f1eda4/gr1.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验