• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于实体位置标记的远程监督生物医学实体关系抽取方法。

Tell me your position: Distantly supervised biomedical entity relation extraction using entity position marker.

机构信息

School of Information Science and Engineering, Shandong Normal University, Jinan, China.

School of Data and Computer Science, Shandong Women's University, Jinan, China.

出版信息

Neural Netw. 2023 Nov;168:531-538. doi: 10.1016/j.neunet.2023.09.043. Epub 2023 Sep 29.

DOI:10.1016/j.neunet.2023.09.043
PMID:37837742
Abstract

A significant amount of textual data has been produced in the biomedical area recently as a result of the advancement of biomedical technologies. Large-scale biomedical data can be automatically obtained with the help of distant supervision. However, the noisy data brought by distant supervision methods makes relation extraction tasks more difficult. Previous work has focused more on how to restore mislabeled relationships, but little attention has been paid to the importance of labeled entity locations for relationship extraction tasks. In this paper, we present a "four-stage" model based on BioBERT and Multi-Instance Learning by using entity position markers. Firstly, the sentence is marked with position. Secondly, BioBERT, a biomedical pre-trained language model, is used in the final sentence feature vector representation not only with the global position marker but also with the start and end marker of both the head and tail entity. Thirdly, the aggregation of sentence vectors in the bag is used as the vector feature of the bag by three aggregation methods, and the performance of different sentence feature vectors combined with different bag encoding methods is discussed. At last, relation classification is performed at the bag level. According to experimental results, the presented model significantly outperforms all baseline models and contributes to noise reduction. In addition, different bag encoding methods need to match corresponding sentence encoding representation to achieve the best performance.

摘要

最近,随着生物医学技术的进步,生物医学领域产生了大量的文本数据。借助远程监督,可以自动获取大规模的生物医学数据。然而,远程监督方法带来的嘈杂数据使得关系抽取任务更加困难。以前的工作更多地关注如何恢复错误标记的关系,但很少关注标记实体位置对关系抽取任务的重要性。在本文中,我们提出了一种基于 BioBERT 和多实例学习的“四阶段”模型,该模型使用实体位置标记符。首先,对句子进行位置标记。其次,使用生物医学预训练语言模型 BioBERT,不仅使用全局位置标记符,还使用头实体和尾实体的起始和结束标记符,对最终句子特征向量表示进行标记。然后,通过三种聚合方法,将袋子中句子向量的聚合作为袋子的向量特征,并讨论不同句子特征向量与不同袋子编码方法相结合的性能。最后,在袋子级别进行关系分类。根据实验结果,所提出的模型显著优于所有基线模型,并有助于减少噪声。此外,不同的袋子编码方法需要匹配相应的句子编码表示,以达到最佳性能。

相似文献

1
Tell me your position: Distantly supervised biomedical entity relation extraction using entity position marker.基于实体位置标记的远程监督生物医学实体关系抽取方法。
Neural Netw. 2023 Nov;168:531-538. doi: 10.1016/j.neunet.2023.09.043. Epub 2023 Sep 29.
2
Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction.利用基于实体的门控卷积和多层次句子注意力提高远程监督关系抽取。
Comput Intell Neurosci. 2021 Nov 1;2021:6110885. doi: 10.1155/2021/6110885. eCollection 2021.
3
Enhancing Biomedical Relation Extraction with Transformer Models using Shortest Dependency Path Features and Triplet Information.利用最短依赖路径特征和三元组信息增强基于 Transformer 的生物医学关系抽取
J Biomed Inform. 2021 Oct;122:103893. doi: 10.1016/j.jbi.2021.103893. Epub 2021 Sep 2.
4
BioBERT: a pre-trained biomedical language representation model for biomedical text mining.BioBERT:一种用于生物医学文本挖掘的预训练生物医学语言表示模型。
Bioinformatics. 2020 Feb 15;36(4):1234-1240. doi: 10.1093/bioinformatics/btz682.
5
Distant supervision for relation extraction with hierarchical selective attention.基于层次选择性注意的关系抽取的远程监督
Neural Netw. 2018 Dec;108:240-247. doi: 10.1016/j.neunet.2018.08.016. Epub 2018 Aug 29.
6
Relation Extraction in Biomedical Texts Based on Multi-Head Attention Model With Syntactic Dependency Feature: Modeling Study.基于具有句法依存特征的多头注意力模型的生物医学文本关系抽取:建模研究
JMIR Med Inform. 2022 Oct 20;10(10):e41136. doi: 10.2196/41136.
7
BioEGRE: a linguistic topology enhanced method for biomedical relation extraction based on BioELECTRA and graph pointer neural network.BioEGRE:一种基于 BioELECTRA 和图指针神经网络的生物医学关系抽取的语言拓扑增强方法。
BMC Bioinformatics. 2023 Dec 19;24(1):486. doi: 10.1186/s12859-023-05601-9.
8
LBERT: Lexically aware Transformer-based Bidirectional Encoder Representation model for learning universal bio-entity relations.LBERT:基于词汇感知的基于Transformer的双向编码器表示模型,用于学习通用生物实体关系。
Bioinformatics. 2021 Apr 20;37(3):404-412. doi: 10.1093/bioinformatics/btaa721.
9
FGSI: distant supervision for relation extraction method based on fine-grained semantic information.FGSI:基于细粒度语义信息的关系抽取远程监督方法
Sci Rep. 2023 Aug 28;13(1):14075. doi: 10.1038/s41598-023-41354-4.
10
Learning entity-oriented representation for biomedical relation extraction.学习面向实体的表示用于生物医学关系抽取。
J Biomed Inform. 2023 Nov;147:104527. doi: 10.1016/j.jbi.2023.104527. Epub 2023 Oct 16.