• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于人工智能的多模态数据融合实现高效临床决策过程:一项新冠肺炎案例研究。

Efficient clinical decision-making process via AI-based multimodal data fusion: A COVID-19 case study.

作者信息

Morís Daniel I, de Moura Joaquim, Marcos Pedro J, Míguez Rey Enrique, Novo Jorge, Ortega Marcos

机构信息

Varpa Group, Biomedical Research Institute A Coruña (INIBIC), University of A Coruña, 15006, A Coruña, Spain.

Department of Computer Science and Information Technologies, University of A Coruña, 15071, A Coruña, Spain.

出版信息

Heliyon. 2024 Oct 10;10(20):e38642. doi: 10.1016/j.heliyon.2024.e38642. eCollection 2024 Oct 30.

DOI:10.1016/j.heliyon.2024.e38642
PMID:39640748
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11619951/
Abstract

COVID-19 is an infectious disease that caused a global pandemic in 2020. In the critical moments of this healthcare emergencies, the medical staff needs to take important decisions in a context of limited resources that must be carefully managed. To this end, the computer-aided diagnosis methods are extremely powerful and help them to better recognize the evidences of high-risk patients. This can be done with the support of relevant information extracted from electronic health records, lab tests and imaging studies. In this work, we present a novel fully-automatic efficient method to help the clinical decision-making process in the context of COVID-19 risk estimation, using multimodal data fusion of clinical features and deep features extracted from chest X-ray images. The risk estimation is studied in two of the most relevant and critical encountered scenarios: the risk of hospitalization and mortality. This study shows which are the most important features for each scenario, the ratio of clinical and imaging features present in the top ranking and the performance of the used machine learning models. The results demonstrate a great performance by the classifiers, estimating the risk of hospitalization with an AUC-ROC of 0.8452 ± 0.0133 and the risk of death with an AUC-ROC of 0.8285 ± 0.0210, only using a subset of the original features, and highlight the significant contribution of imaging features to hospitalization risk assessment, while clinical features become more crucial for mortality risk evaluation. Furthermore, multimodal data fusion can outperform the approaches that use one data source. Despite the model's complexity, it requires fewer features, an advantage in scenarios with limited computational resources. This streamlined, fully-automated method shows promising potential to improve the clinical decision-making process and better manage medical resources, not only in the context of COVID-19, but also in other clinical scenarios.

摘要

新型冠状病毒肺炎(COVID-19)是一种在2020年引发全球大流行的传染病。在这场医疗紧急情况的关键时刻,医护人员需要在必须谨慎管理的有限资源背景下做出重要决策。为此,计算机辅助诊断方法极为强大,可帮助他们更好地识别高危患者的证据。这可以借助从电子健康记录、实验室检查和影像学研究中提取的相关信息来实现。在这项工作中,我们提出了一种新颖的全自动高效方法,利用临床特征与从胸部X线图像中提取的深度特征的多模态数据融合,在COVID-19风险评估的背景下辅助临床决策过程。我们在两个最相关且关键的常见场景中研究风险评估:住院风险和死亡风险。本研究展示了每个场景中最重要的特征、排名靠前的临床和影像特征的比例以及所使用机器学习模型的性能。结果表明,分类器表现出色,仅使用原始特征的一个子集,住院风险评估的曲线下面积(AUC-ROC)为0.8452±0.0133,死亡风险评估的AUC-ROC为0.8285±0.0210,并突出了影像特征对住院风险评估的显著贡献,而临床特征在死亡风险评估中变得更为关键。此外,多模态数据融合的表现优于使用单一数据源的方法。尽管模型复杂,但它所需的特征更少,这在计算资源有限的场景中是一个优势。这种简化的全自动方法不仅在COVID-19背景下,而且在其他临床场景中,都显示出改善临床决策过程和更好管理医疗资源的广阔潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/66d7141e2dd8/gr009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/a72b41438ed3/gr001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/7e36f48bfb4f/gr002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/5f3a235a810f/gr003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/94e715af7918/gr004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/5e6a816481d2/gr005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/d9b5a0034be9/gr006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/8cad12e0262b/gr007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/7c019f029ad6/gr008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/66d7141e2dd8/gr009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/a72b41438ed3/gr001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/7e36f48bfb4f/gr002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/5f3a235a810f/gr003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/94e715af7918/gr004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/5e6a816481d2/gr005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/d9b5a0034be9/gr006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/8cad12e0262b/gr007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/7c019f029ad6/gr008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9a84/11619951/66d7141e2dd8/gr009.jpg

相似文献

1
Efficient clinical decision-making process via AI-based multimodal data fusion: A COVID-19 case study.基于人工智能的多模态数据融合实现高效临床决策过程:一项新冠肺炎案例研究。
Heliyon. 2024 Oct 10;10(20):e38642. doi: 10.1016/j.heliyon.2024.e38642. eCollection 2024 Oct 30.
2
Comprehensive analysis of clinical data for COVID-19 outcome estimation with machine learning models.使用机器学习模型对COVID-19结果估计的临床数据进行综合分析。
Biomed Signal Process Control. 2023 Jul;84:104818. doi: 10.1016/j.bspc.2023.104818. Epub 2023 Mar 9.
3
DEELE-Rad: exploiting deep radiomics features in deep learning models using COVID-19 chest X-ray images.DEELE-Rad:利用新冠肺炎胸部X光图像在深度学习模型中挖掘深度放射组学特征
Health Inf Sci Syst. 2024 Dec 29;13(1):11. doi: 10.1007/s13755-024-00330-6. eCollection 2025 Dec.
4
Multimodal deep learning for predicting in-hospital mortality in heart failure patients using longitudinal chest X-rays and electronic health records.使用纵向胸部X光片和电子健康记录的多模态深度学习预测心力衰竭患者的院内死亡率
Int J Cardiovasc Imaging. 2025 Mar;41(3):427-440. doi: 10.1007/s10554-025-03322-z. Epub 2025 Jan 9.
5
Does imbalance in chest X-ray datasets produce biased deep learning approaches for COVID-19 screening?胸部 X 射线数据集的不平衡是否会导致用于 COVID-19 筛查的深度学习方法产生偏差?
BMC Med Res Methodol. 2022 Apr 28;22(1):125. doi: 10.1186/s12874-022-01578-w.
6
Accurately Differentiating Between Patients With COVID-19, Patients With Other Viral Infections, and Healthy Individuals: Multimodal Late Fusion Learning Approach.准确区分 COVID-19 患者、其他病毒感染患者和健康个体:多模态晚期融合学习方法。
J Med Internet Res. 2021 Jan 6;23(1):e25535. doi: 10.2196/25535.
7
Machine learning algorithms for predicting COVID-19 mortality in Ethiopia.用于预测埃塞俄比亚 COVID-19 死亡率的机器学习算法。
BMC Public Health. 2024 Jun 28;24(1):1728. doi: 10.1186/s12889-024-19196-0.
8
A novel multimodal fusion framework for early diagnosis and accurate classification of COVID-19 patients using X-ray images and speech signal processing techniques.一种使用 X 射线图像和语音信号处理技术对 COVID-19 患者进行早期诊断和准确分类的新型多模态融合框架。
Comput Methods Programs Biomed. 2022 Nov;226:107109. doi: 10.1016/j.cmpb.2022.107109. Epub 2022 Sep 12.
9
A Novel Method for COVID-19 Diagnosis Using Artificial Intelligence in Chest X-ray Images.一种利用人工智能对胸部X光图像进行COVID-19诊断的新方法。
Healthcare (Basel). 2021 Apr 29;9(5):522. doi: 10.3390/healthcare9050522.
10
Mortality Prediction Analysis among COVID-19 Inpatients Using Clinical Variables and Deep Learning Chest Radiography Imaging Features.基于临床变量和深度学习胸部 X 线影像特征的 COVID-19 住院患者死亡率预测分析。
Tomography. 2022 Jul 13;8(4):1791-1803. doi: 10.3390/tomography8040151.

本文引用的文献

1
Machine learning with multimodal data for COVID-19.用于新冠肺炎的多模态数据机器学习
Heliyon. 2023 Jul 5;9(7):e17934. doi: 10.1016/j.heliyon.2023.e17934. eCollection 2023 Jul.
2
Fusion-Extracted Features by Deep Networks for Improved COVID-19 Classification with Chest X-ray Radiography.通过深度网络融合提取特征以改进基于胸部X光片的COVID-19分类
Healthcare (Basel). 2023 May 10;11(10):1367. doi: 10.3390/healthcare11101367.
3
DeepCOVID-Fuse: A Multi-Modality Deep Learning Model Fusing Chest X-rays and Clinical Variables to Predict COVID-19 Risk Levels.
深度新冠融合模型:一种融合胸部X光和临床变量以预测新冠风险水平的多模态深度学习模型。
Bioengineering (Basel). 2023 May 5;10(5):556. doi: 10.3390/bioengineering10050556.
4
Explanatory predictive model for COVID-19 severity risk employing machine learning, shapley addition, and LIME.采用机器学习、Shapley 加法和 LIME 算法对 COVID-19 严重程度风险进行解释性预测模型。
Sci Rep. 2023 Apr 4;13(1):5481. doi: 10.1038/s41598-023-31542-7.
5
Predicting the mortality of patients with Covid-19: A machine learning approach.预测新冠病毒疾病(Covid-19)患者的死亡率:一种机器学习方法。
Health Sci Rep. 2023 Mar 30;6(4):e1162. doi: 10.1002/hsr2.1162. eCollection 2023 Apr.
6
Comprehensive analysis of clinical data for COVID-19 outcome estimation with machine learning models.使用机器学习模型对COVID-19结果估计的临床数据进行综合分析。
Biomed Signal Process Control. 2023 Jul;84:104818. doi: 10.1016/j.bspc.2023.104818. Epub 2023 Mar 9.
7
Machine learning prediction for COVID-19 disease severity at hospital admission.机器学习预测入院时 COVID-19 疾病严重程度。
BMC Med Inform Decis Mak. 2023 Mar 7;23(1):46. doi: 10.1186/s12911-023-02132-4.
8
Improving the performance of machine learning algorithms for health outcomes predictions in multicentric cohorts.提高机器学习算法在多中心队列中对健康结果预测的性能。
Sci Rep. 2023 Jan 19;13(1):1022. doi: 10.1038/s41598-022-26467-6.
9
Machine learning to analyse omic-data for COVID-19 diagnosis and prognosis.机器学习分析新冠病毒诊断和预后的组学数据。
BMC Bioinformatics. 2023 Jan 6;24(1):7. doi: 10.1186/s12859-022-05127-6.
10
Body-mass index COVID-19 severity: A systematic review of systematic reviews.体重指数与新冠肺炎严重程度:系统评价的系统综述
J Family Med Prim Care. 2022 Sep;11(9):5351-5360. doi: 10.4103/jfmpc.jfmpc_396_22. Epub 2022 Oct 14.