Title
Incorporating Common Knowledge And Specific Entity Linking Knowledge For Machine Reading Comprehension
Abstract
Machine comprehension of texts often requires external common knowledge and coreference resolution in the passage. However, most current machine reading comprehension models only incorporate external common knowledge. We propose CoSp model, which incorporates both common knowledge and specific entity linking knowledge for machine reading comprehension. It employs an attention mechanism to adaptively select relevant commonsense and lexical common knowledge from knowledge bases, then it leverages the relational-GCN for reasoning on the entity graph, which is constructed by the entity coreference and co-occurrence for each passage. Hence we obtain knowledge-aware and coreference-aware contextual word representation for answer prediction. Experimental results indicate that CoSp model offers significant and consistent improvements over BERT, outperforming competitive knowledge-aware models on ReCoRD and SQuAD1.1 benchmarks.
Year
DOI
Venue
2021
10.1007/978-3-030-82153-1_45
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III
Keywords
DocType
Volume
Machine reading comprehension, Knowledge-aware question answering, Entity graph, Graph convolutional network, Knowledge base
Conference
12817
ISSN
Citations 
PageRank 
0302-9743
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Shoukang Han101.35
Neng Gao216.44
Xiaobo Guo302.03
Yiwei Shan400.34