• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

GenoPath-MCA:用于生存预测的基因组学与病理学之间的多模态掩码交叉注意力机制

GenoPath-MCA: Multimodal masked cross-attention between genomics and pathology for survival prediction.

作者信息

Zhang Kaixuan, Dong Shuqi, Shi Peifeng, Hu Dingcan, Gao Geng, Yang Jinlin, Gan Tao, Rao Nini

机构信息

Brain-Computer Interface & Brain-Inspired Intelligence Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, Sichuan, China.

Digestive Endoscopic Center of West China Hospital, Sichuan University, Chengdu, 610017, Sichuan, China.

出版信息

Comput Med Imaging Graph. 2026 Feb;128:102699. doi: 10.1016/j.compmedimag.2026.102699. Epub 2026 Jan 5.

DOI:10.1016/j.compmedimag.2026.102699
PMID:41505837
Abstract

Survival prediction using whole slide images (WSIs) and bulk genes is a key task in computational pathology, essential for automated risk assessment and personalized treatment planning. While integrating WSIs with genomic features presents challenges due to inconsistent modality granularity, semantic disparity, and the lack of personalized fusion. We propose GenoPath-MCA, a novel multimodal framework that models dense cross-modal interactions between histopathology and gene expression data. A masked co-attention mechanism aligns features across modalities, and the Multimodal Masked Cross-Attention Module (M2CAM) jointly captures high-order image-gene and gene-gene relationships for enhanced semantic fusion. To address patient-level heterogeneity, we develop a Dynamic Modality Weight Adjustment Strategy (DMWAS) that adaptively modulates fusion weights based on the discriminative relevance of each modality. Additionally, an importance-guided patch selection strategy effectively filters redundant visual inputs, reducing computational cost while preserving critical context. Experiments on public multimodal cancer survival datasets demonstrate that GenoPath-MCA significantly outperforms existing methods in terms of concordance index and robustness. Visualizations of multimodal attention maps validate the biological interpretability and clinical potential of our approach.

摘要

使用全切片图像(WSIs)和大量基因进行生存预测是计算病理学中的一项关键任务,对于自动风险评估和个性化治疗规划至关重要。虽然将WSIs与基因组特征整合存在挑战,因为模态粒度不一致、语义差异以及缺乏个性化融合。我们提出了GenoPath-MCA,这是一种新颖的多模态框架,用于对组织病理学和基因表达数据之间的密集跨模态交互进行建模。一种掩码协同注意力机制跨模态对齐特征,并且多模态掩码交叉注意力模块(M2CAM)联合捕获高阶图像-基因和基因-基因关系以增强语义融合。为了解决患者水平的异质性,我们开发了一种动态模态权重调整策略(DMWAS),该策略基于每种模态的判别相关性自适应地调节融合权重。此外,一种重要性引导的补丁选择策略有效地过滤冗余视觉输入,在保留关键上下文的同时降低计算成本。在公共多模态癌症生存数据集上的实验表明,GenoPath-MCA在一致性指数和稳健性方面显著优于现有方法。多模态注意力图的可视化验证了我们方法的生物学可解释性和临床潜力。

相似文献

1
GenoPath-MCA: Multimodal masked cross-attention between genomics and pathology for survival prediction.GenoPath-MCA:用于生存预测的基因组学与病理学之间的多模态掩码交叉注意力机制
Comput Med Imaging Graph. 2026 Feb;128:102699. doi: 10.1016/j.compmedimag.2026.102699. Epub 2026 Jan 5.
2
Cross-modal alignment and contrastive learning for enhanced cancer survival prediction.用于增强癌症生存预测的跨模态对齐与对比学习
Comput Methods Programs Biomed. 2025 May;263:108633. doi: 10.1016/j.cmpb.2025.108633. Epub 2025 Feb 7.
3
iMCN: information compression-based multimodal confidence-guided fusion network for cancer survival prediction.iMCN:用于癌症生存预测的基于信息压缩的多模态置信度引导融合网络。
Biomed Phys Eng Express. 2026 Feb 3;12(1). doi: 10.1088/2057-1976/ae3b46.
4
An attention-based framework for integrating WSI and genomic data in cancer survival prediction.一种基于注意力的框架,用于在癌症生存预测中整合全切片图像(WSI)和基因组数据。
J Biomed Inform. 2025 Aug;168:104836. doi: 10.1016/j.jbi.2025.104836. Epub 2025 Jun 6.
5
Pathway-Aware Multimodal Transformer (PAMT): Integrating Pathological Image and Gene Expression for Interpretable Cancer Survival Analysis.
IEEE Trans Pattern Anal Mach Intell. 2026 Jan;48(1):896-913. doi: 10.1109/TPAMI.2025.3611531.
6
Interpretable Cancer Survival Prediction by Fusing Semantic Labelling of Cell Types and Whole Slide Images.通过融合细胞类型的语义标记和全切片图像进行可解释的癌症生存预测。
Interdiscip Sci. 2025 Sep 26. doi: 10.1007/s12539-025-00744-0.
7
MIF: Multi-Shot Interactive Fusion Model for Cancer Survival Prediction Using Pathological Image and Genomic Data.MIF:使用病理图像和基因组数据进行癌症生存预测的多镜头交互式融合模型
IEEE J Biomed Health Inform. 2025 May;29(5):3247-3258. doi: 10.1109/JBHI.2024.3363161. Epub 2025 May 6.
8
MMsurv: a multimodal multi-instance multi-cancer survival prediction model integrating pathological images, clinical information, and sequencing data.MMsurv:一种整合病理图像、临床信息和测序数据的多模态多实例多癌症生存预测模型。
Brief Bioinform. 2025 May 1;26(3). doi: 10.1093/bib/bbaf209.
9
MSurv: Fusing Multi-slide and Multi-omics for Memory-augmented robust Survival prediction.
Med Image Anal. 2026 Jan;107(Pt B):103846. doi: 10.1016/j.media.2025.103846. Epub 2025 Oct 16.
10
Dual-path neural network extracts tumor microenvironment information from whole slide images to predict molecular typing and prognosis of Glioma.双路径神经网络从全切片图像中提取肿瘤微环境信息,以预测胶质瘤的分子分型和预后。
Comput Methods Programs Biomed. 2025 Apr;261:108580. doi: 10.1016/j.cmpb.2024.108580. Epub 2025 Jan 4.