Chen Weijie, Sá Rui C, Bai Yuntong, Napel Sandy, Gevaert Olivier, Lauderdale Diane S, Giger Maryellen L
Medical Imaging and Data Resource Center (MIDRC), USA.
Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, USA.
Heliyon. 2023 Jul 5;9(7):e17934. doi: 10.1016/j.heliyon.2023.e17934. eCollection 2023 Jul.
In response to the unprecedented global healthcare crisis of the COVID-19 pandemic, the scientific community has joined forces to tackle the challenges and prepare for future pandemics. Multiple modalities of data have been investigated to understand the nature of COVID-19. In this paper, MIDRC investigators present an overview of the state-of-the-art development of multimodal machine learning for COVID-19 and model assessment considerations for future studies. We begin with a discussion of the lessons learned from radiogenomic studies for cancer diagnosis. We then summarize the multi-modality COVID-19 data investigated in the literature including symptoms and other clinical data, laboratory tests, imaging, pathology, physiology, and other omics data. Publicly available multimodal COVID-19 data provided by MIDRC and other sources are summarized. After an overview of machine learning developments using multimodal data for COVID-19, we present our perspectives on the future development of multimodal machine learning models for COVID-19.
为应对新冠疫情这一前所未有的全球医疗危机,科学界联合起来应对挑战并为未来的大流行做准备。人们研究了多种数据模式以了解新冠病毒的本质。在本文中,MIDRC的研究人员概述了用于新冠病毒的多模态机器学习的最新进展以及未来研究的模型评估考量。我们首先讨论从用于癌症诊断的放射基因组学研究中吸取的经验教训。然后我们总结文献中研究的多模态新冠数据,包括症状及其他临床数据、实验室检测、影像学、病理学、生理学和其他组学数据。还总结了MIDRC和其他来源提供的公开可用的多模态新冠数据。在概述了使用多模态数据进行新冠病毒机器学习的进展之后,我们阐述了对用于新冠病毒的多模态机器学习模型未来发展的看法。