Shapiro Jonathan, Baum Sharon, Pavlotzky Felix, Mordehai Yaron Ben, Barzilai Aviv, Freud Tamar, Gershon Rotem
Maccabi Healthcare Services, Dermatology Department, Tel Aviv-Yafo, Israel.
Department of Dermatology, Sheba Medical Center, Ramat-Gan, affiliated with the Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel.
Clin Dermatol. 2024 Sep-Oct;42(5):480-486. doi: 10.1016/j.clindermatol.2024.06.018. Epub 2024 Jun 21.
Psoriasis is an immune-mediated skin disease affecting approximately 3% of the global population. Proper management of this condition necessitates the assessment of the body surface area and the involvement of nails and joints. The integration of natural language processing with electronic medical records (EMRs) has recently shown promise in advancing disease classification and research. This study evaluates the performance of ChatGPT-4, a commercial artificial intelligence platform, in analyzing unstructured EMR data of psoriasis patients, particularly in identifying affected body areas. The study analyzed EMR data from 94 patients treated at the Dermatology Department and Psoriasis Outpatient Clinic of Sheba Medical Center between 2008 and 2022. The data were processed using the ChatGPT-4 interface to identify and report the body areas affected by psoriasis. These identified areas were then categorized, and the accuracy of ChatGPT-4's analysis was compared with that of a senior dermatologist. The results revealed that the dermatologist identified 477 psoriasis-affected body areas. ChatGPT-4 accurately recognized 443 (92.8%) of these areas, missed 34, and incorrectly identified 30 areas as affected. From 94 cases, nail involvement was detected in 32 cases (34.0%), with ChatGPT-4 correctly identifying 29 cases. Joint involvement was noted in 25 cases (26.6%), with 24 correctly identified using ChatGPT-4. Complete accuracy was achieved in 54 cases (57.4%), although inaccuracies were observed in 40 cases (42.6%). We found that cases with more characters, words, or identified body areas were more prone to errors, suggesting that increased data complexity heightens the likelihood of inaccuracies in artificial intelligence analysis. ChatGPT-4 demonstrated high performance in analyzing detailed and complex unstructured EMR data from patients with psoriasis, effectively identifying involved body areas, including nails and joints. This highlights the potential of NLP algorithms to enhance the analysis of unstructured EMR data for both clinical follow-up and research purposes.
银屑病是一种免疫介导的皮肤病,影响着全球约3%的人口。对这种疾病进行恰当管理需要评估体表面积以及指甲和关节的受累情况。自然语言处理与电子病历(EMR)的整合最近在推进疾病分类和研究方面显示出了前景。本研究评估了商业人工智能平台ChatGPT-4在分析银屑病患者非结构化EMR数据方面的性能,特别是在识别受累身体部位方面。该研究分析了2008年至2022年期间在舍巴医疗中心皮肤科和银屑病门诊接受治疗的94名患者的EMR数据。使用ChatGPT-4界面处理这些数据,以识别和报告受银屑病影响的身体部位。然后对这些识别出的部位进行分类,并将ChatGPT-4的分析准确性与一位资深皮肤科医生的分析准确性进行比较。结果显示,皮肤科医生识别出477个受银屑病影响的身体部位。ChatGPT-4准确识别出其中的443个(92.8%),遗漏了34个,并错误地将30个部位识别为受累部位。在94例病例中,检测到32例(34.0%)有指甲受累,ChatGPT-4正确识别出29例。注意到25例(26.6%)有关节受累,ChatGPT-4正确识别出24例。54例(57.4%)实现了完全准确,不过在40例(42.6%)中观察到了不准确情况。我们发现,字符、单词或识别出的身体部位较多的病例更容易出错,这表明数据复杂性增加会提高人工智能分析中出现不准确情况的可能性。ChatGPT-4在分析银屑病患者详细而复杂的非结构化EMR数据方面表现出高性能,能有效识别受累身体部位,包括指甲和关节。这凸显了自然语言处理算法在增强非结构化EMR数据分析以用于临床随访和研究目的方面的潜力。