Title
Reasoning in Vector Space: An Exploratory Study of Question Answering
Abstract
Question answering tasks have shown remarkable progress with distributed vector representation. In this paper, we investigate the recently proposed Facebook bAbI tasks which consist of twenty different categories of questions that require complex reasoning. Because the previous work on bAbI are all end-to-end models, errors could come from either an imperfect understanding of semantics or in certain steps of the reasoning. For clearer analysis, we propose two vector space models inspired by Tensor Product Representation (TPR) to perform knowledge encoding and logical reasoning based on common-sense inference. They together achieve near-perfect accuracy on all categories including positional reasoning and path finding that have proved difficult for most of the previous approaches. We hypothesize that the difficulties in these categories are due to the multi-relations in contrast to uni-relational characteristic of other categories. Our exploration sheds light on designing more sophisticated dataset and moving one step toward integrating transparent and interpretable formalism of TPR into existing learning paradigms.
Year
Venue
Field
2015
international conference on learning representations
Tensor product,Logical reasoning,Vector space,Question answering,Computer science,Inference,Artificial intelligence,Natural language processing,Formalism (philosophy),Machine learning,Semantics,Encoding (memory)
DocType
Volume
Citations 
Journal
abs/1511.06426
12
PageRank 
References 
Authors
1.08
9
6
Name
Order
Citations
PageRank
Moontae Lee1163.52
Xiaodong He23858190.28
Wen-tau Yih33238204.01
Jianfeng Gao45729296.43
Deng, Li59691728.14
Paul Smolensky621593.76