Title
Biomedical Cross-Sentence Relation Extraction Via Multihead Attention And Graph Convolutional Networks
Abstract
Most biomedical information extraction efforts are focused on binary relations, there is a strong need to extract drug-gene-mutation n-ary relations among cross-sentences. In recent years, end to-end biomedical relation extraction with sequence-based or dependency-based method has gained increasing attention. However, handling global dependencies and structural information remains challenges for sequence-based and dependency-based models. Joint exploitation of sequence and graph information may improve biomedical cross-sentence relation extraction. In this paper, we present a hybrid model for extracting biomedical relation in a cross-sentence which aims to address these problems. Our models rely on the self-attention mechanism that directly draws the global dependency relation of the sentence. Furthermore, to preserve the dependency structural information between the words that contain the syntactic dependency relations, we employ graph convolutional networks that encode the dependency structural information to guide the multihead attention to learn the dependency relation. Through extensive experiments on benchmark datasets, we demonstrated the effectiveness of our method. (C) 2021 Elsevier B.V. All rights reserved.
Year
DOI
Venue
2021
10.1016/j.asoc.2021.107230
APPLIED SOFT COMPUTING
Keywords
DocType
Volume
Biomedical information extraction, Cross-sentence relation, Multihead attention, Graph convolutional networks, Attention mechanism
Journal
104
ISSN
Citations 
PageRank 
1568-4946
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Di Zhao113.07
Jian Wang27316.74
Hongfei Lin302.37
Xin Wang400.34
Zhihao Yang500.68
Yijia Zhang611314.67