Zhang Baoyi, Wan Zhuoya, Luo Yige, Zhao Xi, Samayoa Josue, Zhao Weilong, Wu Si
AbbVie Bay Area, South San Francisco, CA, United States.
AbbVie, Inc., North Chicago, IL, United States.
Front Pharmacol. 2025 Aug 20;16:1609079. doi: 10.3389/fphar.2025.1609079. eCollection 2025.
In clinical practice, a variety of techniques are employed to generate diverse data types for each cancer patient. These data types, spanning clinical, genomics, imaging, and other modalities, exhibit significant differences and possess distinct data structures. Therefore, most current analyses focus on a single data modality, limiting the potential of fully utilizing all available data and providing comprehensive insights. Artificial intelligence (AI) methods, adept at handling complex data structures, offer a powerful approach to efficiently integrate multimodal data. The insights derived from such models may ultimately expedite advancements in patient diagnosis, prognosis, and treatment responses. Here, we provide an overview of current advanced multimodal integration strategies and the related clinical potential in oncology field. We start from the key processing methods for single data modalities such as multi-omics, imaging data, and clinical notes. We then include diverse AI methods, covering traditional machine learning, representation learning, and vision language model, tailored to each distinct data modality. We further elaborate on popular multimodal integration strategies and discuss the related strength and weakness. Finally, we explore potential clinical applications including early detection/diagnosis, biomarker discovery, and prediction of clinical outcome. Additionally, we discuss ongoing challenges and outline potential future directions in the field.
Front Pharmacol. 2025-8-20
Alzheimers Dement. 2021-4
Cochrane Database Syst Rev. 2024-10-17
J Clin Epidemiol. 2025-8
J Med Imaging (Bellingham). 2025-3
Clin Orthop Relat Res. 2024-9-1
2025-1
IEEE Rev Biomed Eng. 2025-7-3
NPJ Digit Med. 2025-5-15
Lab Invest. 2025-4-28
Genome Biol. 2025-4-18
Mayo Clin Proc Digit Health. 2024-3-5
IEEE J Biomed Health Inform. 2025-2-11
Radiology. 2025-2