Title
Generative Clausal Networks: Relational Decision Trees as Probabilistic Circuits
Abstract
In many real-world applications, the i.i.d. assumption does not hold and thus capturing the interactions between instances is essential for the task at hand. Recently, a clear connection between predictive modelling such as decision trees and probabilistic circuits, a form of deep probabilistic model, has been established although it is limited to propositional data. We introduce the first connection between relational rule models and probabilistic circuits, obtaining tractable inference from discriminative rule models while operating on the relational domain. Specifically, given a relational rule model, we make use of Mixed Sum-Product Networks (MSPNs)-a deep probabilistic architecture for hybrid domains-to equip them with a full joint distribution over the class and how (often) the rules fire. Our empirical evaluation shows that we can answer a wide range of probabilistic queries on relational data while being robust to missing, out-of-domain data and partial counts. We show that our method generalizes to different distributions outperforming strong baselines. Moreover, due to the clear probabilistic semantics of MSPNs we have informative model interpretations.
Year
DOI
Venue
2021
10.1007/978-3-030-97454-1_18
INDUCTIVE LOGIC PROGRAMMING (ILP 2021)
Keywords
DocType
Volume
Statistical relational learning, Tractable probabilistic models, Rule learning
Conference
13191
ISSN
Citations 
PageRank 
0302-9743
0
0.34
References 
Authors
9
3
Name
Order
Citations
PageRank
Fabrizio Ventola101.35
Devendra Singh Dhami200.68
Kristian Kersting31932154.03