• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

神经影像学中多模态数据融合的进展:概述、挑战及新方向。

Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation.

作者信息

Zhang Yu-Dong, Dong Zhengchao, Wang Shui-Hua, Yu Xiang, Yao Xujing, Zhou Qinghua, Hu Hua, Li Min, Jiménez-Mesa Carmen, Ramirez Javier, Martinez Francisco J, Gorriz Juan Manuel

机构信息

School of Informatics, University of Leicester, Leicester, LE1 7RH, Leicestershire, UK.

Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia.

出版信息

Inf Fusion. 2020 Dec;64:149-187. doi: 10.1016/j.inffus.2020.07.006. Epub 2020 Jul 17.

DOI:10.1016/j.inffus.2020.07.006
PMID:32834795
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7366126/
Abstract

Multimodal fusion in neuroimaging combines data from multiple imaging modalities to overcome the fundamental limitations of individual modalities. Neuroimaging fusion can achieve higher temporal and spatial resolution, enhance contrast, correct imaging distortions, and bridge physiological and cognitive information. In this study, we analyzed over 450 references from PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, and various sources published from 1978 to 2020. We provide a review that encompasses (1) an overview of current challenges in multimodal fusion (2) the current medical applications of fusion for specific neurological diseases, (3) strengths and limitations of available imaging modalities, (4) fundamental fusion rules, (5) fusion quality assessment methods, and (6) the applications of fusion for atlas-based segmentation and quantification. Overall, multimodal fusion shows significant benefits in clinical diagnosis and neuroscience research. Widespread education and further research amongst engineers, researchers and clinicians will benefit the field of multimodal neuroimaging.

摘要

神经成像中的多模态融合结合了来自多种成像模态的数据,以克服单个模态的基本局限性。神经成像融合可以实现更高的时间和空间分辨率,增强对比度,校正成像畸变,并连接生理和认知信息。在本研究中,我们分析了来自PubMed、谷歌学术、IEEE、ScienceDirect、科学网以及1978年至2020年期间各种来源发表的450多篇参考文献。我们提供了一篇综述,涵盖(1)多模态融合当前面临的挑战概述,(2)融合在特定神经系统疾病中的当前医学应用,(3)可用成像模态的优势和局限性,(4)基本融合规则,(5)融合质量评估方法,以及(6)融合在基于图谱的分割和量化中的应用。总体而言,多模态融合在临床诊断和神经科学研究中显示出显著优势。工程师、研究人员和临床医生之间广泛的教育和进一步的研究将有利于多模态神经成像领域。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/1ed8e9fe557a/gr24_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/8a37ee76db0e/gr1_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/4a92bf7bf250/gr2_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/9148152d5e91/gr3_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/0fd5a058164b/gr4_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/39ca33f27ba2/gr5_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/c336b1e4d2e3/gr6_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/7e43531379fb/gr7_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/18cf9e6a0b80/gr8_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/3b5d9969e03e/gr9_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/22d846e9c941/gr10_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/245ca0b61438/gr11_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/6e3116de47a8/gr12_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/7ad313843956/gr13_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/9999a499ce06/gr14_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/c9c5ed3a16e9/gr15_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/d0345bd9acde/gr16_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/32bb0ee2186f/gr17_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/bc0b0bb3a12f/gr18_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/5d28eb02b1ae/gr19_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/08cf1aa31105/gr20_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/98bd9dfb5001/gr21_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/1f744a5f3c05/gr22_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/def329e97343/gr23_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/1ed8e9fe557a/gr24_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/8a37ee76db0e/gr1_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/4a92bf7bf250/gr2_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/9148152d5e91/gr3_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/0fd5a058164b/gr4_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/39ca33f27ba2/gr5_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/c336b1e4d2e3/gr6_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/7e43531379fb/gr7_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/18cf9e6a0b80/gr8_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/3b5d9969e03e/gr9_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/22d846e9c941/gr10_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/245ca0b61438/gr11_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/6e3116de47a8/gr12_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/7ad313843956/gr13_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/9999a499ce06/gr14_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/c9c5ed3a16e9/gr15_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/d0345bd9acde/gr16_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/32bb0ee2186f/gr17_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/bc0b0bb3a12f/gr18_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/5d28eb02b1ae/gr19_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/08cf1aa31105/gr20_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/98bd9dfb5001/gr21_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/1f744a5f3c05/gr22_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/def329e97343/gr23_lrg.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7f26/7366126/1ed8e9fe557a/gr24_lrg.jpg

相似文献

1
Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation.神经影像学中多模态数据融合的进展:概述、挑战及新方向。
Inf Fusion. 2020 Dec;64:149-187. doi: 10.1016/j.inffus.2020.07.006. Epub 2020 Jul 17.
2
General overview on the merits of multimodal neuroimaging data fusion.多模态神经影像学数据融合的优点概述。
Neuroimage. 2014 Nov 15;102 Pt 1:3-10. doi: 10.1016/j.neuroimage.2014.05.018. Epub 2014 May 16.
3
Artificial intelligence-based methods for fusion of electronic health records and imaging data.基于人工智能的电子健康记录与医学影像数据融合方法。
Sci Rep. 2022 Oct 26;12(1):17981. doi: 10.1038/s41598-022-22514-4.
4
Multimodal Neuroimaging: Basic Concepts and Classification of Neuropsychiatric Diseases.多模态神经影像学:神经精神疾病的基本概念与分类
Clin EEG Neurosci. 2019 Jan;50(1):20-33. doi: 10.1177/1550059418782093. Epub 2018 Jun 20.
5
Multimodal neuroimaging computing: a review of the applications in neuropsychiatric disorders.多模态神经影像计算:神经精神疾病应用综述
Brain Inform. 2015 Sep;2(3):167-180. doi: 10.1007/s40708-015-0019-x. Epub 2015 Aug 29.
6
A generalizable brain extraction net (BEN) for multimodal MRI data from rodents, nonhuman primates, and humans.一种可推广的用于啮齿动物、非人灵长类动物和人类多模态 MRI 数据的大脑提取网络(BEN)。
Elife. 2022 Dec 22;11:e81217. doi: 10.7554/eLife.81217.
7
A Neuroimaging Web Services Interface as a Cyber Physical System for Medical Imaging and Data Management in Brain Research: Design Study.作为脑研究中医学成像与数据管理的信息物理系统的神经成像网络服务接口:设计研究
JMIR Med Inform. 2018 Apr 26;6(2):e26. doi: 10.2196/medinform.9063.
8
A statistically motivated framework for simulation of stochastic data fusion models applied to multimodal neuroimaging.一个用于模拟应用于多模态神经成像的随机数据融合模型的基于统计学的框架。
Neuroimage. 2014 Nov 15;102 Pt 1(Pt 1):92-117. doi: 10.1016/j.neuroimage.2014.04.035. Epub 2014 Apr 18.
9
Translational Multimodality Neuroimaging.转化多模态神经影像学
Curr Drug Targets. 2017;18(9):1039-1050. doi: 10.2174/1389450118666170315111542.
10
A review on multimodal medical image fusion: Compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics.多模态医学图像融合综述:对医学模态、多模态数据库、融合技术和质量指标的简明分析。
Comput Biol Med. 2022 May;144:105253. doi: 10.1016/j.compbiomed.2022.105253. Epub 2022 Feb 3.

引用本文的文献

1
Intelligent sensing devices and systems for personalized mental health.用于个性化心理健康的智能传感设备与系统。
Med X. 2025 Dec;3(1). doi: 10.1007/s44258-025-00057-3. Epub 2025 Apr 2.
2
The value of multimodal neuroimaging in the diagnosis and treatment of post-traumatic stress disorder: a narrative review.多模态神经影像学在创伤后应激障碍诊断与治疗中的价值:一项叙述性综述
Transl Psychiatry. 2025 Jun 20;15(1):208. doi: 10.1038/s41398-025-03416-1.
3
Structural-functional brain network coupling during cognitive demand reveals intelligence-relevant communication strategies.

本文引用的文献

1
[The role of multimodality imaging in COVID-19 patients: from diagnosis to clinical monitoring and prognosis].[多模态成像在COVID-19患者中的作用:从诊断到临床监测与预后]
G Ital Cardiol (Rome). 2020 May;21(5):345-353. doi: 10.1714/3343.33132.
2
Network degeneration in Parkinson's disease: multimodal imaging of nigro-striato-cortical dysfunction.帕金森病中的网络退化:黑质纹状体皮质功能障碍的多模态成像。
Brain. 2020 Mar 1;143(3):944-959. doi: 10.1093/brain/awaa019.
3
Modality-specific overlaps in brain structure and function in obsessive-compulsive disorder: Multimodal meta-analysis of case-control MRI studies.
认知需求期间的结构-功能脑网络耦合揭示了与智力相关的通信策略。
Commun Biol. 2025 Jun 4;8(1):855. doi: 10.1038/s42003-025-08231-4.
4
Advancements in deep learning for early diagnosis of Alzheimer's disease using multimodal neuroimaging: challenges and future directions.基于多模态神经影像学的深度学习在阿尔茨海默病早期诊断中的进展:挑战与未来方向。
Front Neuroinform. 2025 May 2;19:1557177. doi: 10.3389/fninf.2025.1557177. eCollection 2025.
5
Multimodal interpretable data-driven models for early prediction of multidrug resistance using multivariate time series.使用多变量时间序列进行多药耐药性早期预测的多模态可解释数据驱动模型。
Health Inf Sci Syst. 2025 May 7;13(1):35. doi: 10.1007/s13755-025-00351-9. eCollection 2025 Dec.
6
A machine learning approach for multimodal data fusion for survival prediction in cancer patients.一种用于癌症患者生存预测的多模态数据融合的机器学习方法。
NPJ Precis Oncol. 2025 May 6;9(1):128. doi: 10.1038/s41698-025-00917-6.
7
Deep learning-based classification of gallbladder lesions in patients with non-diagnostic (GB-RADS 0) ultrasound.基于深度学习的非诊断性(胆囊影像报告和数据系统0级)超声检查患者胆囊病变分类
Clin Exp Hepatol. 2024 Dec;10(4):232-239. doi: 10.5114/ceh.2024.145424. Epub 2024 Dec 11.
8
Small parallel residual convolutional neural network and traffic congestion detection.小型并行残差卷积神经网络与交通拥堵检测
Sci Rep. 2025 Apr 24;15(1):14285. doi: 10.1038/s41598-025-97942-z.
9
Editorial: Clinical application of multimodal imaging in neuro-ophthalmic diseases.社论:多模态成像在神经眼科疾病中的临床应用
Front Neurol. 2025 Apr 2;16:1591128. doi: 10.3389/fneur.2025.1591128. eCollection 2025.
10
Multimodal Brain Growth Patterns: Insights from Canonical Correlation Analysis and Deep Canonical Correlation Analysis with Auto-Encoder.多模态脑生长模式:来自典型相关分析和基于自动编码器的深度典型相关分析的见解
Information (Basel). 2025 Mar;16(3). doi: 10.3390/info16030160. Epub 2025 Feb 20.
强迫症患者脑结构和功能的模态特异性重叠:病例对照 MRI 研究的多模态荟萃分析。
Neurosci Biobehav Rev. 2020 May;112:83-94. doi: 10.1016/j.neubiorev.2020.01.033. Epub 2020 Jan 30.
4
The Value of Neuroimaging Techniques in the Translation and Transdiagnostic Validation of Psychiatric Diagnoses - Selective Review.神经影像学技术在精神疾病诊断的翻译和跨诊断验证中的价值——选择性综述。
Curr Top Med Chem. 2020;20(7):540-553. doi: 10.2174/1568026620666200131095328.
5
Reduced Hippocampal Glutamate and Posterior Cingulate N-Acetyl Aspartate in Mild Cognitive Impairment and Alzheimer's Disease Is Associated with Episodic Memory Performance and White Matter Integrity in the Cingulum: A Pilot Study.轻度认知障碍和阿尔茨海默病患者的海马谷氨酸和后扣带回 N-乙酰天冬氨酸减少与情景记忆表现和扣带白质完整性相关:一项初步研究。
J Alzheimers Dis. 2020;73(4):1385-1405. doi: 10.3233/JAD-190773.
6
Ultra-High Field MRI in Alzheimer's Disease: Effective Transverse Relaxation Rate and Quantitative Susceptibility Mapping of Human Brain In Vivo and Ex Vivo compared to Histology.超高场 MRI 在阿尔茨海默病中的应用:与组织学比较的人脑在体和离体有效横向弛豫率及定量磁化率图。
J Alzheimers Dis. 2020;73(4):1481-1499. doi: 10.3233/JAD-190424.
7
Denoising arterial spin labeling perfusion MRI with deep machine learning.利用深度学习对动脉自旋标记灌注 MRI 进行去噪。
Magn Reson Imaging. 2020 May;68:95-105. doi: 10.1016/j.mri.2020.01.005. Epub 2020 Jan 15.
8
Convolution neural network-based Alzheimer's disease classification using hybrid enhanced independent component analysis based segmented gray matter of T2 weighted magnetic resonance imaging with clinical valuation.基于卷积神经网络的阿尔茨海默病分类,使用基于混合增强独立成分分析的T2加权磁共振成像分割灰质并结合临床评估。
Alzheimers Dement (N Y). 2019 Dec 28;5:974-986. doi: 10.1016/j.trci.2019.10.001. eCollection 2019.
9
Application of Computed Tomography Scan Combined with Electrocardiographic Gating in Hypertensive Patients with Brain and Nerve Diseases.计算机断层扫描扫描结合心电图门控在高血压脑病和神经疾病患者中的应用。
World Neurosurg. 2020 Jun;138:706-713. doi: 10.1016/j.wneu.2019.12.161. Epub 2020 Jan 7.
10
Comparison of the clinical application value of mo-targeted X-ray, color doppler ultrasound and MRI in preoperative comprehensive evaluation of breast cancer.钼靶X线、彩色多普勒超声及MRI在乳腺癌术前综合评估中的临床应用价值比较
Saudi J Biol Sci. 2019 Dec;26(8):1973-1977. doi: 10.1016/j.sjbs.2019.09.009. Epub 2019 Sep 12.