Title
Discrete restricted Boltzmann machines.
Abstract
We describe discrete restricted Boltzmann machines: probabilistic graphical models with bipartite interactions between visible and hidden discrete variables. Examples are binary restricted Boltzmann machines and discrete naive Bayes models. We detail the inference functions and distributed representations arising in these models in terms of configurations of projected products of simplices and normal fans of products of simplices. We bound the number of hidden variables, depending on the cardinalities of their state spaces, for which these models can approximate any probability distribution on their visible states to any given accuracy. In addition, we use algebraic methods and coding theory to compute their dimension.
Year
DOI
Venue
2015
10.5555/2789272.2831135
JOURNAL OF MACHINE LEARNING RESEARCH
Keywords
DocType
Volume
restricted Boltzmann machine,naive Bayes model,representational power,distributed representation,expected dimension
Journal
16
Issue
ISSN
Citations 
1
1532-4435
6
PageRank 
References 
Authors
0.47
23
2
Name
Order
Citations
PageRank
Guido Montúfar122331.42
Jason Morton2205.42