Title
Distant Supervision for Relation Extraction via Piecewise Attention and Bag-Level Contextual Inference
Abstract
Distant supervision (DS) has become an efficient approach for relation extraction (RE) to alleviate the lack of labeled examples in supervised learning. In this paper, we propose a novel neural RE model that combines a bidirectional gated recurrent unit model with a form of hierarchical attention that is better suited to RE. We demonstrate that an additional attention mechanism called piecewise attention, which builds itself upon segment level representations, significantly enhances the performance of the distantly supervised relation extraction task. Our piecewise attention mechanism not only captures crucial segments in each sentence but also reflects the direction of relations between two entities. Furthermore, we propose a contextual inference method that can infer the most likely positive examples of an entity pair in bags with very limited contextual information. In addition, we provide an annotated dataset without false positive examples based on the Riedel testing dataset, and report on the actual performance of several RE models. The experimental results show that our proposed methods outperform the previous state-of-the-art baselines on both original and annotated datasets for the distantly supervised RE task.
Year
DOI
Venue
2019
10.1109/ACCESS.2019.2932041
IEEE ACCESS
Keywords
DocType
Volume
Relation extraction,distant supervision,piecewise attention,bidirectional gated recurrent unit (BiGRU)
Journal
7
ISSN
Citations 
PageRank 
2169-3536
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Van-Thuy Phi101.01
Joan Santoso200.34
Van-Hien Tran301.01
Hiroyuki Shindo412.40
Masashi Shimbo539429.18
Yuji Matsumoto62712.98