Suppr超能文献

人工智能在脊柱侧弯分类中的应用:基于语言模型的研究

Artificial Intelligence in Scoliosis Classification: An Investigation of Language-Based Models.

作者信息

Fabijan Artur, Polis Bartosz, Fabijan Robert, Zakrzewski Krzysztof, Nowosławska Emilia, Zawadzka-Fabijan Agnieszka

机构信息

Department of Neurosurgery, Polish-Mother's Memorial Hospital Research Institute, 93-338 Lodz, Poland.

Independent Researcher, Luton LU2 0GS, UK.

出版信息

J Pers Med. 2023 Dec 9;13(12):1695. doi: 10.3390/jpm13121695.

Abstract

Open-source artificial intelligence models are finding free application in various industries, including computer science and medicine. Their clinical potential, especially in assisting diagnosis and therapy, is the subject of increasingly intensive research. Due to the growing interest in AI for diagnostics, we conducted a study evaluating the abilities of AI models, including ChatGPT, Microsoft Bing, and Scholar AI, in classifying single-curve scoliosis based on radiological descriptions. Fifty-six posturographic images depicting single-curve scoliosis were selected and assessed by two independent neurosurgery specialists, who classified them as mild, moderate, or severe based on Cobb angles. Subsequently, descriptions were developed that accurately characterized the degree of spinal deformation, based on the measured values of Cobb angles. These descriptions were then provided to AI language models to assess their proficiency in diagnosing spinal pathologies. The artificial intelligence models conducted classification using the provided data. Our study also focused on identifying specific sources of information and criteria applied in their decision-making algorithms, aiming for a deeper understanding of the determinants influencing AI decision processes in scoliosis classification. The classification quality of the predictions was evaluated using performance evaluation metrics such as sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and balanced accuracy. Our study strongly supported our hypothesis, showing that among four AI models, ChatGPT 4 and Scholar AI Premium excelled in classifying single-curve scoliosis with perfect sensitivity and specificity. These models demonstrated unmatched rater concordance and excellent performance metrics. In comparing real and AI-generated scoliosis classifications, they showed impeccable precision in all posturographic images, indicating total accuracy (1.0, MAE = 0.0) and remarkable inter-rater agreement, with a perfect Fleiss' Kappa score. This was consistent across scoliosis cases with a Cobb's angle range of 11-92 degrees. Despite high accuracy in classification, each model used an incorrect angular range for the mild stage of scoliosis. Our findings highlight the immense potential of AI in analyzing medical data sets. However, the diversity in competencies of AI models indicates the need for their further development to more effectively meet specific needs in clinical practice.

摘要

开源人工智能模型正在计算机科学和医学等各个行业中得到免费应用。它们的临床潜力,尤其是在辅助诊断和治疗方面,正成为越来越深入研究的主题。由于对人工智能用于诊断的兴趣日益浓厚,我们开展了一项研究,评估包括ChatGPT、微软必应和学术人工智能在内的人工智能模型基于放射学描述对单曲线脊柱侧弯进行分类的能力。选取了56张描绘单曲线脊柱侧弯的姿势图像,由两位独立的神经外科专家进行评估,他们根据Cobb角将其分为轻度、中度或重度。随后,根据Cobb角的测量值,制定了能够准确描述脊柱变形程度的描述。然后将这些描述提供给人工智能语言模型,以评估它们诊断脊柱病变的能力。人工智能模型使用提供的数据进行分类。我们的研究还侧重于识别其决策算法中应用的特定信息来源和标准,旨在更深入地了解影响人工智能在脊柱侧弯分类决策过程的决定因素。使用敏感性、特异性、阳性预测值(PPV)、阴性预测值(NPV)、准确性和平衡准确性等性能评估指标来评估预测的分类质量。我们的研究有力地支持了我们的假设,表明在四个人工智能模型中,ChatGPT 4和学术人工智能高级版在对单曲线脊柱侧弯进行分类方面表现出色,具有完美的敏感性和特异性。这些模型表现出无与伦比的评分者一致性和出色的性能指标。在比较真实的和人工智能生成的脊柱侧弯分类时,它们在所有姿势图像中都显示出无可挑剔的精度,表明完全准确(1.0,平均绝对误差 = 0.0)和显著的评分者间一致性,Fleiss' Kappa评分为完美。在Cobb角范围为11 - 92度的脊柱侧弯病例中都是如此。尽管分类准确率很高,但每个模型在脊柱侧弯轻度阶段使用的角度范围都不正确。我们的研究结果凸显了人工智能在分析医学数据集方面的巨大潜力。然而,人工智能模型能力的多样性表明需要进一步开发它们,以更有效地满足临床实践中的特定需求。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ebed/10744696/6faf5b8d061f/jpm-13-01695-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验