• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

医学诊断的多模态融合方面:全面综述

Multimodality Fusion Aspects of Medical Diagnosis: A Comprehensive Review.

作者信息

Kumar Sachin, Rani Sita, Sharma Shivani, Min Hong

机构信息

Akian College of Science and Engineering, American University of Armenia, Yerevan 0019, Armenia.

Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana 141006, India.

出版信息

Bioengineering (Basel). 2024 Dec 5;11(12):1233. doi: 10.3390/bioengineering11121233.

DOI:10.3390/bioengineering11121233
PMID:39768051
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11672922/
Abstract

Utilizing information from multiple sources is a preferred and more precise method for medical experts to confirm a diagnosis. Each source provides critical information about the disease that might otherwise be absent in other modalities. Combining information from various medical sources boosts confidence in the diagnosis process, enabling the creation of an effective treatment plan for the patient. The scarcity of medical experts to diagnose diseases motivates the development of automatic diagnoses relying on multimodal data. With the progress in artificial intelligence technology, automated diagnosis using multimodal fusion techniques is now possible. Nevertheless, the concept of multimodal medical diagnosis is still new and requires an understanding of the diverse aspects of multimodal data and its related challenges. This review article examines the various aspects of multimodal medical diagnosis to equip readers, academicians, and researchers with necessary knowledge to advance multimodal medical research. The chosen articles in the study underwent thorough screening from reputable journals and publishers to offer high-quality content to readers, who can then apply the knowledge to produce quality research. Besides, the need for multimodal information and the associated challenges are discussed with solutions. Additionally, ethical issues of using artificial intelligence in medical diagnosis is also discussed.

摘要

对医学专家而言,利用来自多个来源的信息是确诊的首选且更精确的方法。每个来源都提供了有关该疾病的关键信息,而这些信息在其他方式中可能并不存在。整合来自各种医学来源的信息可增强诊断过程中的信心,从而能够为患者制定有效的治疗方案。医学专家在疾病诊断方面的短缺促使了依赖多模态数据的自动诊断技术的发展。随着人工智能技术的进步,现在利用多模态融合技术进行自动诊断已成为可能。然而,多模态医学诊断的概念仍然很新,需要了解多模态数据的各个方面及其相关挑战。这篇综述文章探讨了多模态医学诊断的各个方面,为读者、学者和研究人员提供推进多模态医学研究所需的知识。研究中所选的文章经过了来自知名期刊和出版商的全面筛选,以便为读者提供高质量的内容,读者随后可应用这些知识来开展高质量的研究。此外,还讨论了多模态信息的需求以及相关挑战和解决方案。此外,还探讨了在医学诊断中使用人工智能的伦理问题。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/47ddb2205cf1/bioengineering-11-01233-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/91e1bb0f9181/bioengineering-11-01233-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/2dbcd3360125/bioengineering-11-01233-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/f506c9e3b69e/bioengineering-11-01233-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/f9be0ea2a84e/bioengineering-11-01233-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/2a620eed7f41/bioengineering-11-01233-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/fb5f30389f11/bioengineering-11-01233-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/bab748c81a88/bioengineering-11-01233-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/9f53f6f1b8ce/bioengineering-11-01233-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/b74c4d61a5af/bioengineering-11-01233-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/f16dabd398b4/bioengineering-11-01233-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/47ddb2205cf1/bioengineering-11-01233-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/91e1bb0f9181/bioengineering-11-01233-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/2dbcd3360125/bioengineering-11-01233-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/f506c9e3b69e/bioengineering-11-01233-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/f9be0ea2a84e/bioengineering-11-01233-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/2a620eed7f41/bioengineering-11-01233-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/fb5f30389f11/bioengineering-11-01233-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/bab748c81a88/bioengineering-11-01233-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/9f53f6f1b8ce/bioengineering-11-01233-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/b74c4d61a5af/bioengineering-11-01233-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/f16dabd398b4/bioengineering-11-01233-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb6/11672922/47ddb2205cf1/bioengineering-11-01233-g011.jpg

相似文献

1
Multimodality Fusion Aspects of Medical Diagnosis: A Comprehensive Review.医学诊断的多模态融合方面:全面综述
Bioengineering (Basel). 2024 Dec 5;11(12):1233. doi: 10.3390/bioengineering11121233.
2
Advancing healthcare through multimodal data fusion: a comprehensive review of techniques and applications.通过多模态数据融合推进医疗保健:技术与应用的全面综述
PeerJ Comput Sci. 2024 Oct 30;10:e2298. doi: 10.7717/peerj-cs.2298. eCollection 2024.
3
Artificial intelligence-based methods for fusion of electronic health records and imaging data.基于人工智能的电子健康记录与医学影像数据融合方法。
Sci Rep. 2022 Oct 26;12(1):17981. doi: 10.1038/s41598-022-22514-4.
4
The future of Cochrane Neonatal.考克兰新生儿协作网的未来。
Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12.
5
A review on multimodal medical image fusion: Compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics.多模态医学图像融合综述:对医学模态、多模态数据库、融合技术和质量指标的简明分析。
Comput Biol Med. 2022 May;144:105253. doi: 10.1016/j.compbiomed.2022.105253. Epub 2022 Feb 3.
6
Enhanced multimodal medical image fusion via modified DWT with arithmetic optimization algorithm.基于改进的 DWT 与算术优化算法的增强型多模态医学图像融合。
Sci Rep. 2024 Aug 20;14(1):19261. doi: 10.1038/s41598-024-69997-x.
7
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.在流行地区,服用抗叶酸抗疟药物的人群中,叶酸补充剂与疟疾易感性和严重程度的关系。
Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217.
8
A review of deep learning-based information fusion techniques for multimodal medical image classification.深度学习在多模态医学图像分类中的信息融合技术综述。
Comput Biol Med. 2024 Jul;177:108635. doi: 10.1016/j.compbiomed.2024.108635. Epub 2024 May 22.
9
[Research progress on electronic health records multimodal data fusion based on deep learning].基于深度学习的电子健康记录多模态数据融合研究进展
Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2024 Oct 25;41(5):1062-1071. doi: 10.7507/1001-5515.202310011.
10
Data stewardship and curation practices in AI-based genomics and automated microscopy image analysis for high-throughput screening studies: promoting robust and ethical AI applications.基于人工智能的基因组学和用于高通量筛选研究的自动显微镜图像分析中的数据管理与整理实践:推动可靠且符合伦理的人工智能应用。
Hum Genomics. 2025 Feb 23;19(1):16. doi: 10.1186/s40246-025-00716-x.

引用本文的文献

1
AI-Driven Transcriptome Prediction in Human Pathology: From Molecular Insights to Clinical Applications.人工智能驱动的人类病理学转录组预测:从分子洞察到临床应用
Biology (Basel). 2025 Jun 4;14(6):651. doi: 10.3390/biology14060651.
2
Stepping and tapping: combining motor tasks improves cognitive classification.踏步与轻击:结合运动任务可改善认知分类。
Geroscience. 2025 May 8. doi: 10.1007/s11357-025-01678-7.

本文引用的文献

1
Transparency of artificial intelligence/machine learning-enabled medical devices.具备人工智能/机器学习功能的医疗设备的透明度。
NPJ Digit Med. 2024 Jan 26;7(1):21. doi: 10.1038/s41746-023-00992-8.
2
Ethical implications of AI and robotics in healthcare: A review.人工智能和机器人技术在医疗保健中的伦理问题:综述。
Medicine (Baltimore). 2023 Dec 15;102(50):e36671. doi: 10.1097/MD.0000000000036671.
3
Multimodal data fusion for cancer biomarker discovery with deep learning.用于癌症生物标志物发现的深度学习多模态数据融合
Nat Mach Intell. 2023 Apr;5(4):351-362. doi: 10.1038/s42256-023-00633-5. Epub 2023 Apr 6.
4
Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting From Multimodal Data.基于临床启发的多模态数据疾病轨迹预测多模态数据的多代理转换器。
IEEE Trans Med Imaging. 2024 Jan;43(1):529-541. doi: 10.1109/TMI.2023.3312524. Epub 2024 Jan 2.
5
Medical transformer for multimodal survival prediction in intensive care: integration of imaging and non-imaging data.用于重症监护多模态生存预测的医疗变压器:成像和非成像数据的集成。
Sci Rep. 2023 Jul 1;13(1):10666. doi: 10.1038/s41598-023-37835-1.
6
Cancer survival prediction by learning comprehensive deep feature representation for multiple types of genetic data.基于多种类型遗传数据的综合深度学习特征表示进行癌症生存预测。
BMC Bioinformatics. 2023 Jun 28;24(1):267. doi: 10.1186/s12859-023-05392-z.
7
A transformer-based representation-learning model with unified processing of multimodal input for clinical diagnostics.一种基于变压器的表示学习模型,可统一处理临床诊断的多模态输入。
Nat Biomed Eng. 2023 Jun;7(6):743-755. doi: 10.1038/s41551-023-01045-x. Epub 2023 Jun 12.
8
Multimodal deep learning to predict prognosis in adult and pediatric brain tumors.多模态深度学习用于预测成人和儿童脑肿瘤的预后。
Commun Med (Lond). 2023 Mar 29;3(1):44. doi: 10.1038/s43856-023-00276-y.
9
Machine Learning Approaches to Understand Cognitive Phenotypes in People With HIV.机器学习方法理解 HIV 感染者的认知表型。
J Infect Dis. 2023 Mar 17;227(Suppl 1):S48-S57. doi: 10.1093/infdis/jiac293.
10
Pancancer survival prediction using a deep learning architecture with multimodal representation and integration.使用具有多模态表示和整合的深度学习架构进行泛癌生存预测。
Bioinform Adv. 2023 Jan 23;3(1):vbad006. doi: 10.1093/bioadv/vbad006. eCollection 2023.