Berkowitz Family Living Laboratory, Harvard Medical School, Boston, Massachusetts, USA.
Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA; email:
Annu Rev Biomed Data Sci. 2024 Aug;7(1):345-368. doi: 10.1146/annurev-biodatasci-110723-024625. Epub 2024 Jul 24.
In clinical artificial intelligence (AI), graph representation learning, mainly through graph neural networks and graph transformer architectures, stands out for its capability to capture intricate relationships and structures within clinical datasets. With diverse data-from patient records to imaging-graph AI models process data holistically by viewing modalities and entities within them as nodes interconnected by their relationships. Graph AI facilitates model transfer across clinical tasks, enabling models to generalize across patient populations without additional parameters and with minimal to no retraining. However, the importance of human-centered design and model interpretability in clinical decision-making cannot be overstated. Since graph AI models capture information through localized neural transformations defined on relational datasets, they offer both an opportunity and a challenge in elucidating model rationale. Knowledge graphs can enhance interpretability by aligning model-driven insights with medical knowledge. Emerging graph AI models integrate diverse data modalities through pretraining, facilitate interactive feedback loops, and foster human-AI collaboration, paving the way toward clinically meaningful predictions.
在临床人工智能(AI)中,图表示学习主要通过图神经网络和图转换器架构脱颖而出,它能够捕捉临床数据集中复杂的关系和结构。图 AI 模型使用多样化的数据——从患者记录到影像学——通过将模态和其中的实体视为通过关系相互连接的节点,整体地处理数据。图 AI 促进了临床任务之间的模型迁移,使模型能够在不增加参数且无需或只需少量重新训练的情况下,在患者群体中进行泛化。然而,在临床决策中强调以人为中心的设计和模型可解释性的重要性再怎么强调也不为过。由于图 AI 模型通过在关系型数据集上定义的局部神经变换来捕获信息,因此在阐明模型原理方面既提供了机会,也带来了挑战。知识图谱可以通过将模型驱动的见解与医学知识对齐来提高可解释性。新兴的图 AI 模型通过预训练整合多种数据模态,促进交互式反馈循环,并促进人机协作,为实现有临床意义的预测铺平了道路。