Xu Xiaowei, Jiang Ruixuan, Zheng Si, Wang Min, Ju Yi, Li Jiao
Institute of Medical Information, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100020 China.
College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310058 China.
J Healthc Inform Res. 2024 Nov 23;9(1):88-102. doi: 10.1007/s41666-024-00178-1. eCollection 2025 Mar.
Efficiently classifying chronic dizziness disorders, including persistent postural-perceptual dizziness (PPPD), anxiety, and depressive disorders, is crucial, particularly in primary healthcare settings. This study introduces DizzyInsight, an innovative etiological classification model, designed to enhance the accuracy and reliability of large language model (LLM) and machine learning approaches for etiological classification of chronic dizziness. Eight physicians specializing in chronic dizziness diagnosis, affiliated with the Clinical Center for Vertigo and Balance Disturbance at Beijing Tiantan Hospital, Capital Medical University, furnished comprehensive definitions and evaluations of chronic dizziness characteristics. The study included 260 patients, consisting of 105 males and 155 females, with a mean age of 59.52 ± 13 years. These patients were recruited from the same center between July 2021 and October 2023. For comparative analysis, we utilized the general models bidirectional encoder representations from transformers (BERT) and LLM to assess different outcomes. Seven major categories and 33 subcategory evidence have been defined for etiological classification of chronic dizziness. With DizzyInsight, we constructed the feature dataset regarding chronic dizziness. The DizzyInsight based on the identified evidence of LLM method yielded a positive predictive value of 0.69, a sensitivity of 0.86 for persistent postural-perceptual dizziness (PPPD), a positive predictive value of 0.81, and a sensitivity of 0.66 for anxiety and depressive disorders. These findings highlight the potential of DizzyInsight leveraging LLM to improve the efficacy and interpretability of machine learning models in etiological classification of chronic dizziness disorders. Further research and model development are necessary to improve the accuracy of evidence identification and assess the applicability of DizzyInsight in primary care settings, as well as to evaluate its external validity.
有效区分慢性头晕疾病,包括持续性姿势 - 知觉性头晕(PPPD)、焦虑症和抑郁症,至关重要,尤其是在基层医疗环境中。本研究引入了DizzyInsight,这是一种创新的病因分类模型,旨在提高大语言模型(LLM)和机器学习方法对慢性头晕病因分类的准确性和可靠性。八名在北京天坛医院眩晕与平衡障碍临床中心从事慢性头晕诊断的医生,提供了慢性头晕特征的全面定义和评估。该研究纳入了260名患者,其中男性105名,女性155名,平均年龄为59.52 ± 13岁。这些患者于2021年7月至2023年10月从同一中心招募。为了进行比较分析,我们使用了通用模型双向编码器表征来自变换器(BERT)和LLM来评估不同结果。已为慢性头晕的病因分类定义了七个主要类别和33个子类别证据。借助DizzyInsight,我们构建了关于慢性头晕的特征数据集。基于LLM方法识别出的证据的DizzyInsight,对持续性姿势 - 知觉性头晕(PPPD)的阳性预测值为0.69,敏感性为0.86,对焦虑症和抑郁症的阳性预测值为0.81,敏感性为0.66。这些发现突出了DizzyInsight利用LLM提高机器学习模型在慢性头晕疾病病因分类中的功效和可解释性的潜力。有必要进行进一步的研究和模型开发,以提高证据识别的准确性,评估DizzyInsight在基层医疗环境中的适用性,并评估其外部有效性。