Evaluation of the impact Of ChatGPT support on acromegaly management and patient education.

PURPOSE

ChatGPT is a widely used artificial intelligence modeling tool. Healthcare is one potential area of use of ChatGPT. This study aimed to test the usability and reliability of ChatGPT in acromegaly, which is less known in society and should be evaluated by a group of specialized physicians.

METHODS

The study is designed in two parts. For the first part, 35 questions regarding acromegaly that patients frequently ask were identified, and these questions were asked to ChatGPT. In the second part, four patient examples were presented to ChatGPT using medical terminology. Three experts evaluated ChatGPT's answers to the questions and approaches in case management using 7-point scales in terms of safety, reliability, correctness, and usability.

RESULTS

When the ChatGPT answers to the patient's questions were evaluated, a mean score of 6.78 ± 0.55 was given for correctness and 6.69 ± 0.60 for reliability. The mean scores given by the raters for correctness, safety and usability in the evaluation of the cases were as follows: 6.33 ± 0.88, 6.16 ± 0. 71 and 6.08 ± 0.79 points for case 1; 5.35 ± 1.88, 5.29 ± 1.80 and 5.20 ± 1.86 points for case 2; 6.08 ± 0.97, 6.00 ± 0.93 and 5.91 ± 0.82 points for case 3; 6.10 ± 1.29, 6.13 ± 1.30 and 6.16 ± 1.14 points for case 4.

CONCLUSION

ChatGPT can actively answer the questions of acromegaly patients. Although it is not a reliable source alone in managing patients with acromegaly, it can be a supportive tool for physicians.