Title
Dynamically Pruned Message Passing Networks for Large-scale Knowledge Graph Reasoning
Abstract
We propose Dynamically Pruned Message Passing Networks (DPMPN) for large-scale knowledge graph reasoning. In contrast to existing models, embedding-based or path-based, we learn an input-dependent subgraph to explicitly model a sequential reasoning process. Each subgraph is dynamically constructed, expanding itself selectively under a flow-style attention mechanism. In this way, we can not only construct graphical explanations to interpret prediction, but also prune message passing in Graph Neural Networks (GNNs) to scale with the size of graphs. We take the inspiration from the consciousness prior proposed by Bengio to design a two-GNN framework to encode global input-invariant graph-structured representation and learn local input-dependent one coordinated by an attention module. Experiments show the reasoning capability in our model that is providing a clear graphical explanation as well as predicting results accurately, outperforming most state-of-the-art methods in knowledge base completion tasks.
Year
Venue
Keywords
2020
ICLR
knowledge graph reasoning, graph neural networks, attention mechanism
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
38
6
Name
Order
Citations
PageRank
Xiaoran Xu1514.34
Wei Feng22279.59
Yunsheng Jiang391.18
Xiaohui Xie400.34
Zhiqing Sun5175.67
Zhi-Hong Deng618523.33