Suppr超能文献

当他们说大麻会导致抑郁,但它是你最喜欢的抗抑郁药时:用于关系抽取的知识感知注意力框架。

"When they say weed causes depression, but it's your fav antidepressant": Knowledge-aware attention framework for relationship extraction.

机构信息

Wright State University, Dayton, Ohio, United States of America.

University of South Carolina, Columbia, South Carolina, United States of America.

出版信息

PLoS One. 2021 Mar 25;16(3):e0248299. doi: 10.1371/journal.pone.0248299. eCollection 2021.

Abstract

With the increasing legalization of medical and recreational use of cannabis, more research is needed to understand the association between depression and consumer behavior related to cannabis consumption. Big social media data has potential to provide deeper insights about these associations to public health analysts. In this interdisciplinary study, we demonstrate the value of incorporating domain-specific knowledge in the learning process to identify the relationships between cannabis use and depression. We develop an end-to-end knowledge infused deep learning framework (Gated-K-BERT) that leverages the pre-trained BERT language representation model and domain-specific declarative knowledge source (Drug Abuse Ontology) to jointly extract entities and their relationship using gated fusion sharing mechanism. Our model is further tailored to provide more focus to the entities mention in the sentence through entity-position aware attention layer, where ontology is used to locate the target entities position. Experimental results show that inclusion of the knowledge-aware attentive representation in association with BERT can extract the cannabis-depression relationship with better coverage in comparison to the state-of-the-art relation extractor.

摘要

随着医用和娱乐用大麻合法化的不断推进,我们需要开展更多研究,以了解抑郁与大麻消费行为之间的关联。大型社交媒体数据可能有助于公共卫生分析师更深入地了解这些关联。在这项跨学科研究中,我们展示了在学习过程中纳入特定领域知识的价值,以确定大麻使用与抑郁之间的关系。我们开发了一种端到端的知识融合深度学习框架(门控 K-BERT),该框架利用了预训练的 BERT 语言表示模型和特定领域的声明性知识源(药物滥用本体),通过门控融合共享机制共同提取实体及其关系。我们的模型进一步进行了定制,以通过实体位置感知注意力层为句子中提到的实体提供更多关注,其中本体用于定位目标实体的位置。实验结果表明,与最先进的关系提取器相比,在 BERT 中加入知识感知注意力表示可以更好地提取大麻与抑郁之间的关系。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e366/7993863/025600eb8fef/pone.0248299.g001.jpg

相似文献

2
Extracting comprehensive clinical information for breast cancer using deep learning methods.
Int J Med Inform. 2019 Dec;132:103985. doi: 10.1016/j.ijmedinf.2019.103985. Epub 2019 Oct 2.
3
Korean clinical entity recognition from diagnosis text using BERT.
BMC Med Inform Decis Mak. 2020 Sep 30;20(Suppl 7):242. doi: 10.1186/s12911-020-01241-8.
6
Tell me your position: Distantly supervised biomedical entity relation extraction using entity position marker.
Neural Netw. 2023 Nov;168:531-538. doi: 10.1016/j.neunet.2023.09.043. Epub 2023 Sep 29.
7
Multiple features for clinical relation extraction: A machine learning approach.
J Biomed Inform. 2020 Mar;103:103382. doi: 10.1016/j.jbi.2020.103382. Epub 2020 Feb 3.
10
BioBERT: a pre-trained biomedical language representation model for biomedical text mining.
Bioinformatics. 2020 Feb 15;36(4):1234-1240. doi: 10.1093/bioinformatics/btz682.

引用本文的文献

本文引用的文献

2
Improving the Generalizability of Convolutional Neural Network-Based Segmentation on CMR Images.
Front Cardiovasc Med. 2020 Jun 30;7:105. doi: 10.3389/fcvm.2020.00105. eCollection 2020.
3
Listed for sale: Analyzing data on fentanyl, fentanyl analogs and other novel synthetic opioids on one cryptomarket.
Drug Alcohol Depend. 2020 Aug 1;213:108115. doi: 10.1016/j.drugalcdep.2020.108115. Epub 2020 Jun 12.
4
Global trends, local harms: availability of fentanyl-type drugs on the dark web and accidental overdoses in Ohio.
Comput Math Organ Theory. 2019 Mar;25(1):48-59. doi: 10.1007/s10588-018-09283-0. Epub 2018 Oct 25.
6
BioBERT: a pre-trained biomedical language representation model for biomedical text mining.
Bioinformatics. 2020 Feb 15;36(4):1234-1240. doi: 10.1093/bioinformatics/btz682.
7
Dual CNN for Relation Extraction with Knowledge-Based Attention and Word Embeddings.
Comput Intell Neurosci. 2019 Jul 14;2019:6789520. doi: 10.1155/2019/6789520. eCollection 2019.
8
Knowledge-guided convolutional networks for chemical-disease relation extraction.
BMC Bioinformatics. 2019 May 21;20(1):260. doi: 10.1186/s12859-019-2873-7.
9
Position-aware deep multi-task learning for drug-drug interaction extraction.
Artif Intell Med. 2018 May;87:1-8. doi: 10.1016/j.artmed.2018.03.001. Epub 2018 Mar 17.
10
DataMed - an open source discovery index for finding biomedical datasets.
J Am Med Inform Assoc. 2018 Mar 1;25(3):300-308. doi: 10.1093/jamia/ocx121.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验