Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning unbelievable marginal probabilities   Loopy belief propagation performs approximate inference on graphical models
with loops. One might hope to compensate for the approximation by adjusting
model parameters. Learning algorithms for this purpose have been explored
previously, and the claim has been made that every set of locally consistent
marginals can arise from belief propagation run on a graphical model. On the
contrary, here we show that many probability distributions have marginals that
cannot be reached by belief propagation using any set of model parameters or
any learning algorithm. We call such marginals `unbelievable.' This problem
occurs whenever the Hessian of the Bethe free energy is not positive-definite
at the target marginals. All learning algorithms for belief propagation
necessarily fail in these cases, producing beliefs or sets of beliefs that may
even be worse than the pre-learning approximation. We then show that averaging
inaccurate beliefs, each obtained from belief propagation using model
parameters perturbed about some learned mean values, can achieve the
unbelievable marginals.

3
The categories of this paper are: physics
6
The categories of this paper are: astro-ph
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
19
The categories of this paper are: eess