Assessing information provided via artificial intelligence regarding distal biceps tendon repair surgery.

PURPOSE

The purpose of this study was to analyze the quality, accuracy, reliability and readability of information provided by an Artificial Intelligence (AI) model ChatGPT (Open AI, San Francisco) regarding Distal Biceps Tendon repair surgery.

METHODS

ChatGPT 3.5 was used to answer 27 commonly asked questions regarding 'distal biceps repair surgery' by patients. These questions were categorized using the Rothwell criteria of and . The answers generated by ChatGPT were analyzed using the DISCERN scale, (JAMA) benchmark criteria, Flesch-Kincaid Reading Ease Score (FRES) and grade Level (FKGL).

RESULTS

The DISCERN score for -based questions was 59, was 61 and was 59 (all considered 'good scores'). The JAMA benchmark criteria were 0, representing the lowest score, for all three categories of and . The FRES score for the questions was 24.49, was 22.82, was 21.77 and the FKGL score for was 14.96, was 14.78 and was 15.00.

CONCLUSION

The answers provided by ChatGPT were a 'good' source in terms of quality assessment, compared to other online resources that do not have citations as an option. The accuracy and reliability of these answers were shown to be low, with nearly a college-graduate level of readability. This indicates that physicians should caution patients when searching ChatGPT for information regarding distal biceps repairs. ChatGPT serves as a promising source for patients to learn about their procedure, although its reliability and readability are disadvantages for the average patient when utilizing the software.