• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于在线掩蔽自动编码器的混合图卷积网络在稳健的多模态癌症生存预测中的应用。

Hybrid Graph Convolutional Network With Online Masked Autoencoder for Robust Multimodal Cancer Survival Prediction.

出版信息

IEEE Trans Med Imaging. 2023 Aug;42(8):2462-2473. doi: 10.1109/TMI.2023.3253760. Epub 2023 Aug 1.

DOI:10.1109/TMI.2023.3253760
PMID:37028064
Abstract

Cancer survival prediction requires exploiting related multimodal information (e.g., pathological, clinical and genomic features, etc.) and it is even more challenging in clinical practices due to the incompleteness of patient's multimodal data. Furthermore, existing methods lack sufficient intra- and inter-modal interactions, and suffer from significant performance degradation caused by missing modalities. This manuscript proposes a novel hybrid graph convolutional network, entitled HGCN, which is equipped with an online masked autoencoder paradigm for robust multimodal cancer survival prediction. Particularly, we pioneer modeling the patient's multimodal data into flexible and interpretable multimodal graphs with modality-specific preprocessing. HGCN integrates the advantages of graph convolutional networks (GCNs) and a hypergraph convolutional network (HCN) through node message passing and a hyperedge mixing mechanism to facilitate intra-modal and inter-modal interactions between multimodal graphs. With HGCN, the potential for multimodal data to create more reliable predictions of patient's survival risk is dramatically increased compared to prior methods. Most importantly, to compensate for missing patient modalities in clinical scenarios, we incorporated an online masked autoencoder paradigm into HGCN, which can effectively capture intrinsic dependence between modalities and seamlessly generate missing hyperedges for model inference. Extensive experiments and analysis on six cancer cohorts from TCGA show that our method significantly outperforms the state-of-the-arts in both complete and missing modal settings. Our codes are made available at https://github.com/lin-lcx/HGCN.

摘要

癌症生存预测需要利用相关的多模态信息(例如,病理、临床和基因组特征等),由于患者多模态数据的不完整,在临床实践中这更加具有挑战性。此外,现有的方法缺乏充分的内在和模态间的相互作用,并且由于模态的缺失而导致性能显著下降。本文提出了一种新颖的混合图卷积网络,称为 HGCN,它配备了在线掩蔽自动编码器范例,用于稳健的多模态癌症生存预测。特别是,我们开创性地将患者的多模态数据建模为具有特定模态预处理的灵活和可解释的多模态图。HGCN 通过节点消息传递和超边混合机制集成了图卷积网络(GCN)和超图卷积网络(HCN)的优点,以促进多模态图之间的内在模态和模态间的相互作用。与之前的方法相比,HGCN 极大地提高了多模态数据对患者生存风险进行更可靠预测的潜力。最重要的是,为了在临床场景中弥补患者模态的缺失,我们将在线掩蔽自动编码器范例纳入 HGCN 中,该范例可以有效地捕获模态之间的内在依赖关系,并为模型推断无缝生成缺失的超边。在来自 TCGA 的六个癌症队列上进行的广泛实验和分析表明,我们的方法在完整和缺失模态设置下都显著优于最先进的方法。我们的代码可在 https://github.com/lin-lcx/HGCN 上获得。

相似文献

1
Hybrid Graph Convolutional Network With Online Masked Autoencoder for Robust Multimodal Cancer Survival Prediction.基于在线掩蔽自动编码器的混合图卷积网络在稳健的多模态癌症生存预测中的应用。
IEEE Trans Med Imaging. 2023 Aug;42(8):2462-2473. doi: 10.1109/TMI.2023.3253760. Epub 2023 Aug 1.
2
SELECTOR: Heterogeneous graph network with convolutional masked autoencoder for multimodal robust prediction of cancer survival.基于卷积掩蔽自动编码器的异质图网络用于癌症生存的多模态稳健预测。
Comput Biol Med. 2024 Apr;172:108301. doi: 10.1016/j.compbiomed.2024.108301. Epub 2024 Mar 15.
3
MMGCN: Multi-modal multi-view graph convolutional networks for cancer prognosis prediction.多模态多视图图卷积网络用于癌症预后预测。
Comput Methods Programs Biomed. 2024 Dec;257:108400. doi: 10.1016/j.cmpb.2024.108400. Epub 2024 Sep 6.
4
Drug Repositioning Based on the Enhanced Message Passing and Hypergraph Convolutional Networks.基于增强消息传递和超图卷积网络的药物重定位。
Biomolecules. 2022 Nov 10;12(11):1666. doi: 10.3390/biom12111666.
5
EHR-HGCN: An Enhanced Hybrid Approach for Text Classification Using Heterogeneous Graph Convolutional Networks in Electronic Health Records.EHR-HGCN:一种在电子健康记录中使用异构图卷积网络的增强型混合文本分类方法。
IEEE J Biomed Health Inform. 2024 Mar;28(3):1668-1679. doi: 10.1109/JBHI.2023.3346210. Epub 2024 Mar 6.
6
Hyperbolic Graph Convolutional Neural Networks.双曲图卷积神经网络
Adv Neural Inf Process Syst. 2019 Dec;32:4869-4880.
7
TGNet: tensor-based graph convolutional networks for multimodal brain network analysis.TGNet:用于多模态脑网络分析的基于张量的图卷积网络
BioData Min. 2024 Dec 6;17(1):55. doi: 10.1186/s13040-024-00409-6.
8
A novel transformer autoencoder for multi-modal emotion recognition with incomplete data.一种基于新型Transformer 自编码器的多模态情感识别方法,适用于不完全数据。
Neural Netw. 2024 Apr;172:106111. doi: 10.1016/j.neunet.2024.106111. Epub 2024 Jan 6.
9
Multiview hyperedge-aware hypergraph embedding learning for multisite, multiatlas fMRI based functional connectivity network analysis.用于基于多站点、多图谱功能磁共振成像的功能连接网络分析的多视图超边感知超图嵌入学习
Med Image Anal. 2024 May;94:103144. doi: 10.1016/j.media.2024.103144. Epub 2024 Mar 19.
10
DER-GCN: Dialog and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialog Emotion Recognition.DER-GCN:用于多模态对话情感识别的对话与事件关系感知图卷积神经网络
IEEE Trans Neural Netw Learn Syst. 2025 Mar;36(3):4908-4921. doi: 10.1109/TNNLS.2024.3367940. Epub 2025 Feb 28.

引用本文的文献

1
Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis.人工智能驱动的生物医学多模态数据融合与分析中的挑战。
Genomics Proteomics Bioinformatics. 2025 May 10;23(1). doi: 10.1093/gpbjnl/qzaf011.
2
MSR-UNet: enhancing multi-scale and long-range dependencies in medical image segmentation.MSR-UNet:增强医学图像分割中的多尺度和远距离依赖性
PeerJ Comput Sci. 2024 Dec 3;10:e2563. doi: 10.7717/peerj-cs.2563. eCollection 2024.
3
Graph Artificial Intelligence in Medicine.图形人工智能在医学中的应用。
Annu Rev Biomed Data Sci. 2024 Aug;7(1):345-368. doi: 10.1146/annurev-biodatasci-110723-024625. Epub 2024 Jul 24.