Kahlon Sunny, Sleet Mary, Sujka Joseph, Docimo Salvatore, DuCoin Christopher, Dimou Francesca, Mhaskar Rahul
University of South Florida Health Morsani College of Medicine, Tampa, FL, USA.
Department of Surgery, University of South Florida Morsani College of Medicine, Tampa, FL, USA.
Can J Physiol Pharmacol. 2025 Feb 1;103(2):70-74. doi: 10.1139/cjpp-2024-0026. Epub 2024 Nov 19.
Integrating artificial intelligence (AI) into healthcare prompts the need to measure its proficiency relative to human experts. This study evaluates the proficiency of ChatGPT, an OpenAI language model, in offering guidance concerning bariatric surgery compared to bariatric surgeons. Five clinical scenarios representative of diverse bariatric surgery situations were given to American Society for Metabolic and Bariatric Surgery (ASMBS)-accredited bariatric surgeons and ChatGPT. Both groups proposed medical or surgical management for the patients depicted in each scenario. The outcomes from both the surgeons and ChatGPT were examined and matched with the clinical benchmarks set by the ASMBS. There was a high degree of agreement between ChatGPT and physicians on the three simpler clinical scenarios. There was a positive correlation between physicians' and ChatGPT answers for not recommending surgery. ChatGPT's advice aligned with ASMBS guidelines 60% of the time, in contrast to bariatric surgeons, who consistently aligned with the guidelines 100% of the time. ChatGPT showcases potential in offering guidance on bariatric surgery, but it does not have the comprehensive and personalized perspective that doctors exhibit consistently. Enhancing AI's training on intricate patient situations will bolster its role in the medical field.
将人工智能（AI）整合到医疗保健领域引发了衡量其相对于人类专家熟练程度的需求。本研究评估了OpenAI语言模型ChatGPT在提供与减肥手术相关指导方面相对于减肥外科医生的熟练程度。向美国代谢与减肥外科学会（ASMBS）认证的减肥外科医生和ChatGPT提供了代表不同减肥手术情况的五个临床场景。两组都针对每个场景中描述的患者提出了医疗或手术管理方案。对外科医生和ChatGPT的结果进行了检查，并与ASMBS设定的临床基准进行了匹配。在三个较简单的临床场景中，ChatGPT与医生之间存在高度一致性。对于不建议进行手术的情况，医生和ChatGPT的回答之间存在正相关。ChatGPT的建议有60%的时间与ASMBS指南一致，相比之下，减肥外科医生始终100%地与指南一致。ChatGPT在提供减肥手术指导方面展现出潜力，但它不具备医生始终展现出的全面和个性化视角。加强AI在复杂患者情况方面的训练将增强其在医疗领域的作用。
