Zhang Yaoyun, Tang Buzhou, Jiang Min, Wang Jingqi, Xu Hua
University of Texas School of Biomedical Informatics at Houston, Houston, TX, USA.
University of Texas School of Biomedical Informatics at Houston, Houston, TX, USA Department of Computer Science, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen, Guangdong, China.
J Am Med Inform Assoc. 2015 Sep;22(5):967-79. doi: 10.1093/jamia/ocu048. Epub 2015 Jun 10.
OBJECTIVE: Semantic role labeling (SRL), which extracts a shallow semantic relation representation from different surface textual forms of free text sentences, is important for understanding natural language. Few studies in SRL have been conducted in the medical domain, primarily due to lack of annotated clinical SRL corpora, which are time-consuming and costly to build. The goal of this study is to investigate domain adaptation techniques for clinical SRL leveraging resources built from newswire and biomedical literature to improve performance and save annotation costs. MATERIALS AND METHODS: Multisource Integrated Platform for Answering Clinical Questions (MiPACQ), a manually annotated SRL clinical corpus, was used as the target domain dataset. PropBank and NomBank from newswire and BioProp from biomedical literature were used as source domain datasets. Three state-of-the-art domain adaptation algorithms were employed: instance pruning, transfer self-training, and feature augmentation. The SRL performance using different domain adaptation algorithms was evaluated by using 10-fold cross-validation on the MiPACQ corpus. Learning curves for the different methods were generated to assess the effect of sample size. RESULTS AND CONCLUSION: When all three source domain corpora were used, the feature augmentation algorithm achieved statistically significant higher F-measure (83.18%), compared to the baseline with MiPACQ dataset alone (F-measure, 81.53%), indicating that domain adaptation algorithms may improve SRL performance on clinical text. To achieve a comparable performance to the baseline method that used 90% of MiPACQ training samples, the feature augmentation algorithm required <50% of training samples in MiPACQ, demonstrating that annotation costs of clinical SRL can be reduced significantly by leveraging existing SRL resources from other domains.
J Am Med Inform Assoc. 2015-9
Bioinformatics. 2010-2-23
AMIA Annu Symp Proc. 2017-2-10
BMC Bioinformatics. 2008-12-12
BMC Med Inform Decis Mak. 2015
AMIA Annu Symp Proc. 2018-4-16
BMC Bioinformatics. 2008-6-11
AMIA Annu Symp Proc. 2005
Annu Rev Biomed Data Sci. 2018-7
JMIR Med Inform. 2020-11-5
J Pers Med. 2020-7-16
PLoS One. 2020-6-22
AMIA Jt Summits Transl Sci Proc. 2018-5-18
AMIA Annu Symp Proc. 2018-4-16
BMC Med Inform Decis Mak. 2018-3-22
J Biomed Inform. 2017-6-7
Artif Intell Med. 2014-7
Stud Health Technol Inform. 2013
J Am Med Inform Assoc. 2013-3-13
J Am Med Inform Assoc. 2013-1-25
AMIA Annu Symp Proc. 2012
Bioinformatics. 2012-10-8
Bioinformatics. 2010-2-23
J Biomed Inform. 2010-2-10
J Am Med Inform Assoc. 2010