• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用掩码注意力和多尺度进行多模态脑磁共振成像分类

: using mask-attention and multi-scale for multi-modal brain MRI classification.

作者信息

Kong Guanqing, Wu Chuanfu, Zhang Zongqiu, Yin Chuansheng, Qin Dawei

机构信息

Linyi People's Hospital, Linyi City, Shandong Province, China.

Linyi Key Laboratory of Health Data Science, Linyi City, Shandong Province, China.

出版信息

Front Neuroinform. 2024 Jul 29;18:1403732. doi: 10.3389/fninf.2024.1403732. eCollection 2024.

DOI:10.3389/fninf.2024.1403732
PMID:39139696
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11320416/
Abstract

INTRODUCTION

Brain diseases, particularly the classification of gliomas and brain metastases and the prediction of HT in strokes, pose significant challenges in healthcare. Existing methods, relying predominantly on clinical data or imaging-based techniques such as radiomics, often fall short in achieving satisfactory classification accuracy. These methods fail to adequately capture the nuanced features crucial for accurate diagnosis, often hindered by noise and the inability to integrate information across various scales.

METHODS

We propose a novel approach that mask attention mechanisms with multi-scale feature fusion for Multimodal brain disease classification tasks, termed , which aims to extract features highly relevant to the disease. The extracted features are then dimensionally reduced using Principal Component Analysis (PCA), followed by classification with a Support Vector Machine (SVM) to obtain the predictive results.

RESULTS

Our methodology underwent rigorous testing on multi-parametric MRI datasets for both brain tumors and strokes. The results demonstrate a significant improvement in addressing critical clinical challenges, including the classification of gliomas, brain metastases, and the prediction of hemorrhagic stroke transformations. Ablation studies further validate the effectiveness of our attention mechanism and feature fusion modules.

DISCUSSION

These findings underscore the potential of our approach to meet and exceed current clinical diagnostic demands, offering promising prospects for enhancing healthcare outcomes in the diagnosis and treatment of brain diseases.

摘要

引言

脑部疾病,尤其是胶质瘤和脑转移瘤的分类以及中风中出血转化(HT)的预测,给医疗保健带来了重大挑战。现有方法主要依赖临床数据或基于成像的技术(如放射组学),在实现令人满意的分类准确率方面往往存在不足。这些方法未能充分捕捉对准确诊断至关重要的细微特征,常常受到噪声以及无法跨不同尺度整合信息的阻碍。

方法

我们提出了一种新颖的方法,用于多模态脑部疾病分类任务,该方法采用多尺度特征融合的掩膜注意力机制,称为 ,旨在提取与疾病高度相关的特征。然后使用主成分分析(PCA)对提取的特征进行降维,接着使用支持向量机(SVM)进行分类以获得预测结果。

结果

我们的方法在针对脑肿瘤和中风的多参数MRI数据集上进行了严格测试。结果表明,在应对关键临床挑战方面有显著改进,包括胶质瘤的分类、脑转移瘤以及出血性中风转化的预测。消融研究进一步验证了我们的注意力机制和特征融合模块的有效性。

讨论

这些发现强调了我们的方法满足并超越当前临床诊断需求的潜力,为改善脑部疾病诊断和治疗中的医疗保健结果提供了有前景的前景。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/ef90317834e8/fninf-18-1403732-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/e3091e639722/fninf-18-1403732-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/b19319515951/fninf-18-1403732-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/6857e30a63df/fninf-18-1403732-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/7dd09a09d513/fninf-18-1403732-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/75501e2ff8b3/fninf-18-1403732-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/96b42e43e1b7/fninf-18-1403732-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/ef90317834e8/fninf-18-1403732-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/e3091e639722/fninf-18-1403732-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/b19319515951/fninf-18-1403732-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/6857e30a63df/fninf-18-1403732-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/7dd09a09d513/fninf-18-1403732-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/75501e2ff8b3/fninf-18-1403732-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/96b42e43e1b7/fninf-18-1403732-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/91fe/11320416/ef90317834e8/fninf-18-1403732-g0007.jpg

相似文献

1
: using mask-attention and multi-scale for multi-modal brain MRI classification.使用掩码注意力和多尺度进行多模态脑磁共振成像分类
Front Neuroinform. 2024 Jul 29;18:1403732. doi: 10.3389/fninf.2024.1403732. eCollection 2024.
2
Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases.开发和验证一种多模态融合深度学习模型,用于区分胶质母细胞瘤和单发脑转移瘤。
Zhong Nan Da Xue Xue Bao Yi Xue Ban. 2024 Jan 28;49(1):58-67. doi: 10.11817/j.issn.1672-7347.2024.230248.
3
A multi-instance tumor subtype classification method for small PET datasets using RA-DL attention module guided deep feature extraction with radiomics features.基于 RA-DL 注意力模块引导的放射组学特征深度特征提取的小 PET 数据集多实例肿瘤亚型分类方法。
Comput Biol Med. 2024 May;174:108461. doi: 10.1016/j.compbiomed.2024.108461. Epub 2024 Apr 9.
4
Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages.基于多模态神经影像的多通道 3D 深度特征学习在脑肿瘤患者生存时间预测中的应用。
Sci Rep. 2019 Jan 31;9(1):1103. doi: 10.1038/s41598-018-37387-9.
5
HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease.HAMMF:用于阿尔茨海默病计算机辅助诊断的基于层次注意力的多任务多模态融合模型。
Comput Biol Med. 2024 Jun;176:108564. doi: 10.1016/j.compbiomed.2024.108564. Epub 2024 May 8.
6
Toward attention-based learning to predict the risk of brain degeneration with multimodal medical data.迈向基于注意力的学习,以利用多模态医学数据预测脑退化风险。
Front Neurosci. 2023 Jan 18;16:1043626. doi: 10.3389/fnins.2022.1043626. eCollection 2022.
7
Improving the Classification of PCNSL and Brain Metastases by Developing a Machine Learning Model Based on F-FDG PET.通过开发基于F-FDG PET的机器学习模型来改进原发性中枢神经系统淋巴瘤和脑转移瘤的分类
J Pers Med. 2023 Mar 17;13(3):539. doi: 10.3390/jpm13030539.
8
MAMF-GCN: Multi-scale adaptive multi-channel fusion deep graph convolutional network for predicting mental disorder.MAMF-GCN:用于预测精神障碍的多尺度自适应多通道融合深度图卷积网络。
Comput Biol Med. 2022 Sep;148:105823. doi: 10.1016/j.compbiomed.2022.105823. Epub 2022 Jul 6.
9
Analysis of Hybrid Feature Optimization Techniques Based on the Classification Accuracy of Brain Tumor Regions Using Machine Learning and Further Evaluation Based on the Institute Test Data.基于机器学习的脑肿瘤区域分类准确率的混合特征优化技术分析及基于机构测试数据的进一步评估
J Med Phys. 2024 Jan-Mar;49(1):22-32. doi: 10.4103/jmp.jmp_77_23. Epub 2024 Mar 30.
10
CMAF-Net: a cross-modal attention fusion-based deep neural network for incomplete multi-modal brain tumor segmentation.CMAF-Net:一种基于跨模态注意力融合的深度神经网络,用于不完全多模态脑肿瘤分割。
Quant Imaging Med Surg. 2024 Jul 1;14(7):4579-4604. doi: 10.21037/qims-24-9. Epub 2024 Jun 27.

引用本文的文献

1
Investigating brain tumor classification using MRI: a scientometric analysis of selected articles from 2015 to 2024.利用磁共振成像研究脑肿瘤分类:对2015年至2024年所选文章的科学计量分析
Neuroradiology. 2025 Jul 18. doi: 10.1007/s00234-025-03685-z.

本文引用的文献

1
Weaving attention U-net: A novel hybrid CNN and attention-based method for organs-at-risk segmentation in head and neck CT images.编织注意力 U 网:一种新型的混合 CNN 和基于注意力的头颈部 CT 图像中危及器官分割方法。
Med Phys. 2021 Nov;48(11):7052-7062. doi: 10.1002/mp.15287. Epub 2021 Oct 26.
2
A deep learning-based model for prediction of hemorrhagic transformation after stroke.基于深度学习的脑卒中后出血性转化预测模型。
Brain Pathol. 2023 Mar;33(2):e13023. doi: 10.1111/bpa.13023. Epub 2021 Oct 4.
3
Heart Disease and Stroke Statistics-2021 Update: A Report From the American Heart Association.
心脏病与中风统计-2021 更新:美国心脏协会报告。
Circulation. 2021 Feb 23;143(8):e254-e743. doi: 10.1161/CIR.0000000000000950. Epub 2021 Jan 27.
4
Multi-Scale Self-Guided Attention for Medical Image Segmentation.用于医学图像分割的多尺度自引导注意力机制
IEEE J Biomed Health Inform. 2021 Jan;25(1):121-130. doi: 10.1109/JBHI.2020.2986926. Epub 2021 Jan 5.
5
Clinical-radiomics Nomogram for Risk Estimation of Early Hematoma Expansion after Acute Intracerebral Hemorrhage.临床影像组学列线图预测急性脑出血后早期血肿扩大风险。
Acad Radiol. 2021 Mar;28(3):307-317. doi: 10.1016/j.acra.2020.02.021. Epub 2020 Mar 29.
6
Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images.基于自通道和空间注意力神经网络的头颈部 CT 图像自动多器官分割。
Phys Med Biol. 2020 Dec 11;65(24):245034. doi: 10.1088/1361-6560/ab79c3.
7
Brain tumor classification using deep CNN features via transfer learning.基于迁移学习的深度卷积神经网络特征在脑肿瘤分类中的应用
Comput Biol Med. 2019 Aug;111:103345. doi: 10.1016/j.compbiomed.2019.103345. Epub 2019 Jun 29.
8
A Review on a Deep Learning Perspective in Brain Cancer Classification.关于脑癌分类中深度学习视角的综述
Cancers (Basel). 2019 Jan 18;11(1):111. doi: 10.3390/cancers11010111.
9
Hemorrhagic Transformation in Patients With Acute Ischemic Stroke and Atrial Fibrillation: Time to Initiation of Oral Anticoagulant Therapy and Outcomes.急性缺血性脑卒中合并心房颤动患者的出血性转化:开始口服抗凝治疗的时间与结局。
J Am Heart Assoc. 2018 Nov 20;7(22):e010133. doi: 10.1161/JAHA.118.010133.
10
Prediction of Tissue Outcome and Assessment of Treatment Effect in Acute Ischemic Stroke Using Deep Learning.利用深度学习预测急性缺血性脑卒中的组织结局和评估治疗效果。
Stroke. 2018 Jun;49(6):1394-1401. doi: 10.1161/STROKEAHA.117.019740. Epub 2018 May 2.