呼吁应对人工智能“幻觉”以及医疗专业人员如何降低其风险。
A Call to Address AI "Hallucinations" and How Healthcare Professionals Can Mitigate Their Risks.
作者信息
Hatem Rami, Simmons Brianna, Thornton Joseph E
机构信息
Department of Psychiatry, University of Florida College of Medicine, Gainesville, USA.
出版信息
Cureus. 2023 Sep 5;15(9):e44720. doi: 10.7759/cureus.44720. eCollection 2023 Sep.
Abstract
Artificial intelligence (AI) has transformed society in many ways. AI in medicine has the potential to improve medical care and reduce healthcare professional burnout but we must be cautious of a phenomenon termed "AI hallucinations"and how this term can lead to the stigmatization of AI systems and persons who experience hallucinations. We believe the term "AI misinformation" to be more appropriate and avoids contributing to stigmatization. Healthcare professionals can play an important role in AI's integration into medicine, especially regarding mental health services, so it is important that we continue to critically evaluate AI systems as they emerge.
摘要
人工智能（AI）已在许多方面改变了社会。医学领域的人工智能有潜力改善医疗护理并减轻医疗保健专业人员的职业倦怠，但我们必须警惕一种被称为“AI幻觉”的现象，以及这个术语如何导致对AI系统和经历幻觉的人的污名化。我们认为“AI错误信息”这个术语更合适，并且可以避免造成污名化。医疗保健专业人员在AI融入医学的过程中可以发挥重要作用，尤其是在心理健康服务方面，因此随着AI系统的出现，我们继续对其进行批判性评估非常重要。
相似文献
1
A Call to Address AI "Hallucinations" and How Healthcare Professionals Can Mitigate Their Risks.呼吁应对人工智能“幻觉”以及医疗专业人员如何降低其风险。
Cureus. 2023 Sep 5;15(9):e44720. doi: 10.7759/cureus.44720. eCollection 2023 Sep.
2
Exploring the Role of Artificial Intelligence in Mental Healthcare: Progress, Pitfalls, and Promises.探索人工智能在精神卫生保健中的作用：进展、陷阱与前景。
Cureus. 2023 Sep 5;15(9):e44748. doi: 10.7759/cureus.44748. eCollection 2023 Sep.
3
AI-Enabled Medical Education: Threads of Change, Promising Futures, and Risky Realities Across Four Potential Future Worlds.人工智能辅助医学教育：四大潜在未来世界中的变革脉络、美好前景和风险现实。
JMIR Med Educ. 2023 Dec 25;9:e50373. doi: 10.2196/50373.
4
Assessing prognosis in depression: comparing perspectives of AI models, mental health professionals and the general public.评估抑郁症预后：比较人工智能模型、心理健康专业人员和公众的观点。
Fam Med Community Health. 2024 Jan 9;12(Suppl 1):e002583. doi: 10.1136/fmch-2023-002583.
5
The Role of AI in Hospitals and Clinics: Transforming Healthcare in the 21st Century.人工智能在医院和诊所中的作用：变革21世纪的医疗保健
Bioengineering (Basel). 2024 Mar 29;11(4):337. doi: 10.3390/bioengineering11040337.
6
Unraveling the Ethical Enigma: Artificial Intelligence in Healthcare.解开伦理谜团：医疗保健领域的人工智能
Cureus. 2023 Aug 10;15(8):e43262. doi: 10.7759/cureus.43262. eCollection 2023 Aug.
7
How to mitigate the risks of deployment of artificial intelligence in medicine?如何降低人工智能在医学领域应用的风险？
Turk J Med Sci. 2024 May 20;54(3):483-492. doi: 10.55730/1300-0144.5814. eCollection 2024.
8
Artificial Intelligence-Powered Surgical Consent: Patient Insights.人工智能驱动的手术同意书：患者见解
Cureus. 2024 Aug 29;16(8):e68134. doi: 10.7759/cureus.68134. eCollection 2024 Aug.
9
Artificial Hallucinations by Google Bard: Think Before You Leap.谷歌巴德生成的人工幻觉：三思而后行。
Cureus. 2023 Aug 10;15(8):e43313. doi: 10.7759/cureus.43313. eCollection 2023 Aug.
10
Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy.您的机器人治疗师现在为您服务：具身人工智能在精神病学、心理学和心理治疗中的伦理意义。
J Med Internet Res. 2019 May 9;21(5):e13216. doi: 10.2196/13216.
引用本文的文献
1
Treatment of aphasia in linguistically diverse populations: current and future directions.语言多样化人群失语症的治疗：现状与未来方向。
Front Psychol. 2025 Aug 14;16:1612413. doi: 10.3389/fpsyg.2025.1612413. eCollection 2025.
2
Critical conversations: a user-centric approach to chatbots for history taking in the pediatric intensive care unit.关键对话：一种以用户为中心的儿科重症监护病房病史采集聊天机器人方法。
Front Pediatr. 2025 Aug 12;13:1646989. doi: 10.3389/fped.2025.1646989. eCollection 2025.
3
Multi-model assurance analysis showing large language models are highly vulnerable to adversarial hallucination attacks during clinical decision support.多模型保证分析表明，在临床决策支持过程中，大语言模型极易受到对抗性幻觉攻击。
Commun Med (Lond). 2025 Aug 2;5(1):330. doi: 10.1038/s43856-025-01021-3.
4
AI Scribes in Health Care: Balancing Transformative Potential With Responsible Integration.医疗保健领域的人工智能抄写员：平衡变革潜力与负责任的整合
JMIR Med Inform. 2025 Aug 1;13:e80898. doi: 10.2196/80898.
5
Leveraging AI to Investigate Child Maltreatment Text Narratives: Promising Benefits and Addressable Risks.利用人工智能研究虐待儿童文本叙述：潜在益处与可应对风险
JMIR Pediatr Parent. 2025 Jul 24;8:e73579. doi: 10.2196/73579.
6
Rare diseases: ethical challenges in the era of digital health.罕见病：数字健康时代的伦理挑战
Front Digit Health. 2025 Jul 9;7:1539841. doi: 10.3389/fdgth.2025.1539841. eCollection 2025.
7
Development and Validation of a Large Language Model-Powered Chatbot for Neurosurgery: Mixed Methods Study on Enhancing Perioperative Patient Education.用于神经外科手术的基于大语言模型的聊天机器人的开发与验证：关于加强围手术期患者教育的混合方法研究
J Med Internet Res. 2025 Jul 15;27:e74299. doi: 10.2196/74299.
8
Potential role of large language models and personalized medicine to innovate cardiac rehabilitation.大语言模型和个性化医疗在创新心脏康复中的潜在作用。
World J Clin Cases. 2025 Jul 6;13(19):98095. doi: 10.12998/wjcc.v13.i19.98095.
9
Performance of 3 Conversational Generative Artificial Intelligence Models for Computing Maximum Safe Doses of Local Anesthetics: Comparative Analysis.用于计算局部麻醉药最大安全剂量的3种对话式生成人工智能模型的性能：比较分析
JMIR AI. 2025 May 13;4:e66796. doi: 10.2196/66796.
10
Integration of Generative AI with Human Expertise in HEOR: A Hybrid Intelligence Framework.生成式人工智能与药物卫生技术评估中的人类专业知识的整合：一种混合智能框架。
Adv Ther. 2025 Jun 25. doi: 10.1007/s12325-025-03273-w.
本文引用的文献
1
Chatbot Confabulations Are Not Hallucinations-Reply.聊天机器人的虚构并非幻觉——回复
JAMA Intern Med. 2023 Oct 1;183(10):1177-1178. doi: 10.1001/jamainternmed.2023.3875.
2
Chatbot Confabulations Are Not Hallucinations.聊天机器人的虚构并非幻觉。
JAMA Intern Med. 2023 Oct 1;183(10):1177. doi: 10.1001/jamainternmed.2023.4231.
3
Artificial Hallucinations in ChatGPT: Implications in Scientific Writing.ChatGPT中的人工幻觉：对科学写作的影响
Cureus. 2023 Feb 19;15(2):e35179. doi: 10.7759/cureus.35179. eCollection 2023 Feb.
4
AI in health and medicine.人工智能在医疗中的应用。
Nat Med. 2022 Jan;28(1):31-38. doi: 10.1038/s41591-021-01614-0. Epub 2022 Jan 20.
Zotero 插件