Title
Convergence Analysis of Belief Propagation on Gaussian Graphical Models.
Abstract
Gaussian belief propagation (GBP) is a recursive computation method that is widely used in inference for computing marginal distributions efficiently. Depending on how the factorization of the underlying joint Gaussian distribution is performed, GBP may exhibit different convergence properties as different factorizations may lead to fundamentally different recursive update structures. In this paper, we study the convergence of GBP derived from the factorization based on the distributed linear Gaussian model. The motivation is twofold. From the factorization viewpoint, i.e., by specifically employing a factorization based on the linear Gaussian model, in some cases, we are able to bypass difficulties that exist in other convergence analysis methods that use a different (Gaussian Markov random field) factorization. From the distributed inference viewpoint, the linear Gaussian model readily conforms to the physical network topology arising in large-scale networks, and, is practically useful. For the distributed linear Gaussian model, under mild assumptions, we show analytically three main results: the GBP message inverse variance converges exponentially fast to a unique positive limit for arbitrary nonnegative initialization; we provide a necessary and sufficient convergence condition for the belief mean to converge to the optimal value; and, when the underlying factor graph is given by the union of a forest and a single loop, we show that GBP always converges.
Year
Venue
Field
2018
arXiv: Information Theory
Convergence (routing),Factor graph,Applied mathematics,Mathematical optimization,Gaussian,Gaussian network model,Factorization,Graphical model,Mathematics,Marginal distribution,Belief propagation
DocType
Volume
Citations 
Journal
abs/1801.06430
0
PageRank 
References 
Authors
0.34
1
5
Name
Order
Citations
PageRank
Jian Du1557.27
Shaodan Ma266671.25
Yik-Chung Wu3133594.03
Soummya Kar42710.89
José M. F. Moura55137426.14