Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China.
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China; School of Civil Engineering, Southeast University, Jiangsu, China.
Comput Biol Med. 2024 May;174:108399. doi: 10.1016/j.compbiomed.2024.108399. Epub 2024 Apr 12.
Glaucoma is one of the leading cause of blindness worldwide. Individuals affected by glaucoma, including patients and their family members, frequently encounter a deficit in dependable support beyond the confines of clinical environments. Seeking advice via the internet can be a difficult task due to the vast amount of disorganized and unstructured material available on these sites, nevertheless. This research explores how Large Language Models (LLMs) can be leveraged to better serve medical research and benefit glaucoma patients. We introduce Xiaoqing, a Natural Language Processing (NLP) model specifically tailored for the glaucoma field, detailing its development and deployment. To evaluate its effectiveness, we conducted two forms of experiments: comparative and experiential. In the comparative analysis, we presented 22 glaucoma-related questions in simplified Chinese to three medical NLP models (Xiaoqing LLMs, HuaTuo, Ivy GPT) and two general models (ChatGPT-3.5 and ChatGPT-4), covering a range of topics from basic glaucoma knowledge to treatment, surgery, research, management standards, and patient lifestyle. Responses were assessed for informativeness and readability. The experiential experiment involved glaucoma patients and non-patients interacting with Xiaoqing, collecting and analyzing their questions and feedback on the same criteria. The findings demonstrated that Xiaoqing notably outperformed the other models in terms of informativeness and readability, suggesting that Xiaoqing is a significant advancement in the management and treatment of glaucoma in China. We also provide a Web-based version of Xiaoqing, allowing readers to directly experience its functionality. The Web-based Xiaoqing is available at https://qa.glaucoma-assistant.com//qa.
青光眼是全球致盲的主要原因之一。受青光眼影响的个体,包括患者及其家属,经常在临床环境之外遇到可靠支持的不足。尽管如此,通过互联网寻求建议可能是一项艰巨的任务,因为这些网站上有大量杂乱无章和无结构的材料。本研究探讨了如何利用大型语言模型 (LLMs) 更好地为医学研究服务并使青光眼患者受益。我们介绍了 Xiaoqing,这是一个专门针对青光眼领域的自然语言处理 (NLP) 模型,详细介绍了其开发和部署情况。为了评估其有效性,我们进行了两种形式的实验:比较和体验。在比较分析中,我们用简化中文向三个医学 NLP 模型(Xiaoqing LLM、华陀、Ivy GPT)和两个通用模型(ChatGPT-3.5 和 ChatGPT-4)提出了 22 个与青光眼相关的问题,涵盖了从基本青光眼知识到治疗、手术、研究、管理标准和患者生活方式等方面的一系列主题。评估了回答的信息量和可读性。体验式实验涉及青光眼患者和非患者与 Xiaoqing 的互动,收集并分析了他们基于相同标准的问题和反馈。研究结果表明,Xiaoqing 在信息量和可读性方面明显优于其他模型,这表明 Xiaoqing 是中国青光眼管理和治疗的重大进展。我们还提供了一个基于网络的 Xiaoqing 版本,允许读者直接体验其功能。基于网络的 Xiaoqing 可在 https://qa.glaucoma-assistant.com//qa 上获得。