Title
Adaptive Exact Inference in Graphical Models
Abstract
Many algorithms and applications involve repeatedly solving variations of the same inference problem, for example to introduce new evidence to the model or to change conditional dependencies. As the model is updated, the goal of adaptive inference is to take advantage of previously computed quantities to perform inference more rapidly than from scratch. In this paper, we present algorithms for adaptive exact inference on general graphs that can be used to efficiently compute marginals and update MAP configurations under arbitrary changes to the input factor graph and its associated elimination tree. After a linear time preprocessing step, our approach enables updates to the model and the computation of any marginal in time that is logarithmic in the size of the input model. Moreover, in contrast to max-product our approach can also be used to update MAP configurations in time that is roughly proportional to the number of updated entries, rather than the size of the input model. To evaluate the practical effectiveness of our algorithms, we implement and test them using synthetic data as well as for two real-world computational biology applications. Our experiments show that adaptive inference can achieve substantial speedups over performing complete inference as the model undergoes small changes over time.
Year
DOI
Venue
2011
10.5555/1953048.2078207
Journal of Machine Learning Research
Keywords
Field
DocType
Adaptive Exact Inference,adaptive inference,arbitrary change,inference problem,Graphical Models,updated entry,linear time,complete inference,adaptive exact inference,input model,input factor graph,MAP configuration
Factor graph,Dynamic programming,Variable elimination,Inference,Computer science,Theoretical computer science,Synthetic data,Artificial intelligence,Adaptive neuro fuzzy inference system,Graphical model,Time complexity,Machine learning
Journal
Volume
ISSN
Citations 
12,
1532-4435
5
PageRank 
References 
Authors
0.41
23
4
Name
Order
Citations
PageRank
Özgür Sümer1182.04
Umut A. Acar271645.83
Alexander T. Ihler31377112.01
Ramgopal R. Mettu417722.23