Zhao Zhuoran, Zhou Qing, Wu Chengkai, Su Renbin, Xiong Weihong
College of Computer Science, Chongqing University, Chongqing 400044, China.
Department of Ultrasound, Xinxiang Medical University Henan Provincial People's Hospital, Zhengzhou 450003, China.
J Mol Graph Model. 2024 Nov;132:108843. doi: 10.1016/j.jmgm.2024.108843. Epub 2024 Aug 5.
Deep learning is playing an increasingly important role in accurate prediction of molecular properties. Prior to being processed by a deep learning model, a molecule is typically represented in the form of a text or a graph. While some methods attempt to integrate these two forms of molecular representations, the misalignment of graph and text embeddings presents a significant challenge to fuse two modalities. To solve this problem, we propose a method that aligns and fuses graph and text features in the embedding space by using contrastive loss and cross attentions. Additionally, we enhance the molecular representation by incorporating multi-granularity information of molecules on the levels of atoms, functional groups, and molecules. Extensive experiments show that our model outperforms state-of-the-art models in downstream tasks of molecular property prediction, achieving superior performance with less pretraining data. The source codes and data are available at https://github.com/zzr624663649/multimodal_molecular_property.
深度学习在分子性质的准确预测中发挥着越来越重要的作用。在由深度学习模型处理之前,分子通常以文本或图形的形式表示。虽然一些方法试图整合这两种分子表示形式,但图形和文本嵌入的不对齐对融合这两种模态提出了重大挑战。为了解决这个问题,我们提出了一种方法,通过使用对比损失和交叉注意力在嵌入空间中对齐和融合图形和文本特征。此外,我们通过纳入分子在原子、官能团和分子层面的多粒度信息来增强分子表示。大量实验表明,我们的模型在分子性质预测的下游任务中优于现有模型,在使用更少预训练数据的情况下实现了卓越的性能。源代码和数据可在https://github.com/zzr624663649/multimodal_molecular_property获取。