Suppr超能文献

ICD 10 CM 描述的压缩大型语言模型嵌入数据集。

A compressed large language model embedding dataset of ICD 10 CM descriptions.

机构信息

Department of Biostatistics, School of Public Health, Yale University, New Haven, USA.

The Jackson School of Global Affairs, Yale University, New Haven, USA.

出版信息

BMC Bioinformatics. 2023 Dec 17;24(1):482. doi: 10.1186/s12859-023-05597-2.

Abstract

This paper presents novel datasets providing numerical representations of ICD-10-CM codes by generating description embeddings using a large language model followed by a dimension reduction via autoencoder. The embeddings serve as informative input features for machine learning models by capturing relationships among categories and preserving inherent context information. The model generating the data was validated in two ways. First, the dimension reduction was validated using an autoencoder, and secondly, a supervised model was created to estimate the ICD-10-CM hierarchical categories. Results show that the dimension of the data can be reduced to as few as 10 dimensions while maintaining the ability to reproduce the original embeddings, with the fidelity decreasing as the reduced-dimension representation decreases. Multiple compression levels are provided, allowing users to choose as per their requirements, download and use without any other setup. The readily available datasets of ICD-10-CM codes are anticipated to be highly valuable for researchers in biomedical informatics, enabling more advanced analyses in the field. This approach has the potential to significantly improve the utility of ICD-10-CM codes in the biomedical domain.

摘要

本文提出了新颖的数据集,通过使用大型语言模型生成 ICD-10-CM 代码的描述嵌入,并通过自动编码器进行降维,从而提供 ICD-10-CM 代码的数值表示。这些嵌入通过捕捉类别之间的关系并保留固有上下文信息,成为机器学习模型的有价值的输入特征。用于生成数据的模型通过两种方式进行了验证。首先,通过自动编码器验证了降维,其次,创建了一个监督模型来估计 ICD-10-CM 层次类别。结果表明,数据的维度可以减少到 10 维,同时保持重现原始嵌入的能力,随着降维表示的减少,保真度降低。提供了多个压缩级别,允许用户根据需要选择,无需其他设置即可下载和使用。预计这些易于获取的 ICD-10-CM 代码数据集对于生物医学信息学研究人员非常有价值,能够在该领域进行更先进的分析。这种方法有可能显著提高 ICD-10-CM 代码在生物医学领域的实用性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b578/10726612/2dfd51c37815/12859_2023_5597_Fig1_HTML.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验