Name
Abstract | ||
|---|---|---|
Knowledge base completion is an important research problem in knowledge bases, which play important roles in question answering, information retrieval, and other applications. A number of relational learning algorithms have been proposed to solve this problem. However, despite their success in modeling the entity relations, they are not well founded in a Bayesian manner and thus are hard to model the prior information of the entity and relation factors. Furthermore, they under-represent the interaction between entity and relation factors. In order to avoid these disadvantages, we provide a neural-inspired approach, namely Bayesian Neural Tensor Decomposition approach for knowledge base completion based on the Stochastic Gradient Variational Bayesian framework. We employ a multivariate Bernoulli likelihood function to represent the existence of facts in knowledge graphs. We further employ a Multi-layered Perceptrons to represent more complex interactions between the latent subject, predicate, and object factors. The SGVB framework can enable us to make efficient approximate variational inference for the proposed nonlinear probabilistic tensor decomposition by a novel local reparameterization trick. This way avoids the need of expensive iterative inference schemes such as MCMC and does not make any over-simplified assumptions about the posterior distributions, in contrary to the common variational inference. In order to evaluate the proposed model, we have conducted experiments on real-world knowledge bases, i.e., FreeBase and WordNet. Experimental results have indicated the promising performance of the proposed method. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1007/s12559-018-9565-x | Cognitive Computation |
Keywords | Field | DocType |
Knowledge base completion, Variational Bayesian, Neural networks | Likelihood function,Question answering,Inference,Computer science,Statistical relational learning,Artificial intelligence,Probabilistic logic,Knowledge base,Artificial neural network,Machine learning,Bayesian probability | Journal |
Volume | Issue | ISSN |
10 | 6 | 1866-9956 |
Citations | PageRank | References |
3 | 0.41 | 19 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Lirong He | 1 | 8 | 3.16 |
| Bin Liu | 2 | 18 | 4.00 |
| Guangxi Li | 3 | 3 | 1.76 |
| Yongpan Sheng | 4 | 3 | 0.41 |
| Yafang Wang | 5 | 134 | 13.56 |
| Zenglin Xu | 6 | 923 | 66.28 |