Kerkütlüoğlu Murat, Kaya Erhan, Gökmen Rasim
Cardiology, Kahramanmaraş Sütçü İmam University, Kahramanmaraş, TUR.
Public Health, Kahramanmaraş Sütçü İmam University, Kahramanmaraş, TUR.
Cureus. 2024 Oct 14;16(10):e71472. doi: 10.7759/cureus.71472. eCollection 2024 Oct.
To enhance outcomes for patients with pulmonary arterial hypertension (PAH), comprehensive and individualized therapy is needed. A large language model called Generative Pre-trained Transformer (ChatGPT) has the ability to provide expert yet patient-friendly care. We wanted to determine how well ChatGPT could accurately and consistently respond to inquiries on knowledge and management for PAH.
When 20 PAH patients were diagnosed, they were asked what concerns they had about PAH and what they had researched online. In the evaluation, it was determined that patients frequently searched the Internet for answers to eight queries. These eight queries were posed to ChatGPT, and their responses were recorded. Ten experts in the field of PAH assessed the trustworthiness, value, and hazard of the answers generated by the ChatGPT.
According to evaluations conducted by experts, the ChatGPT-generated responses were deemed trustworthy with an average score of 8.4 (7.7-9.2) and valuable with an average score of 7.9 (7.4-8.2). Based on the statistical analysis, it can be inferred that most professionals believed that the utilization of prompts provided by ChatGPT did not present a substantial risk, with a mean of 2.1 (1.7-2.5). The answers were assessed for readability using two different indicators, namely the Flesch-Kincaid Grade Level (FKGL) and the Simple Measure of Gobbledygook (SMOG). The average FKGL value was determined to be 13.52 ± 2.40, indicating a "difficult" level of readability.
ChatGPT provides reliable PAH-related information, but it is important to seek professional medical advice before making any decisions regarding PAH. ChatGPT can only provide general information and support, but a qualified healthcare provider can offer tailored recommendations.
为改善肺动脉高压（PAH）患者的治疗效果，需要全面且个性化的治疗方法。一种名为生成式预训练变换器（ChatGPT）的大型语言模型有能力提供专业且对患者友好的护理。我们想确定ChatGPT在准确且一致地回答有关PAH知识和管理的询问方面表现如何。
20例PAH患者确诊后，询问他们对PAH的担忧以及在网上搜索的内容。评估发现患者经常在互联网上搜索八个问题的答案。将这八个问题抛给ChatGPT，并记录其回答。10位PAH领域的专家评估了ChatGPT生成答案的可信度、价值和风险。
根据专家评估，ChatGPT生成的回答可信度平均得分为8.4（7.7 - 9.2），被认为是有价值的，平均得分为7.9（7.4 - 8.2）。基于统计分析，可以推断大多数专业人士认为使用ChatGPT提供的提示不存在重大风险，平均值为2.1（1.7 - 2.5）。使用两个不同指标，即弗莱施 - 金凯德年级水平（FKGL）和难词简易衡量法（SMOG）对答案的可读性进行评估。确定平均FKGL值为13.52 ± 2.40，表明可读性为“困难”级别。
ChatGPT提供可靠的PAH相关信息，但在就PAH做出任何决定之前寻求专业医疗建议很重要。ChatGPT只能提供一般信息和支持，但合格的医疗保健提供者可以提供量身定制的建议。
