Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Variational Diffusion Models   Diffusion-based generative models have demonstrated a capacity for
perceptually impressive synthesis, but can they also be great likelihood-based
models? We answer this in the affirmative, and introduce a family of
diffusion-based generative models that obtain state-of-the-art likelihoods on
standard image density estimation benchmarks. Unlike other diffusion-based
models, our method allows for efficient optimization of the noise schedule
jointly with the rest of the model. We show that the variational lower bound
(VLB) simplifies to a remarkably short expression in terms of the
signal-to-noise ratio of the diffused data, thereby improving our theoretical
understanding of this model class. Using this insight, we prove an equivalence
between several models proposed in the literature. In addition, we show that
the continuous-time VLB is invariant to the noise schedule, except for the
signal-to-noise ratio at its endpoints. This enables us to learn a noise
schedule that minimizes the variance of the resulting VLB estimator, leading to
faster optimization. Combining these advances with architectural improvements,
we obtain state-of-the-art likelihoods on image density estimation benchmarks,
outperforming autoregressive models that have dominated these benchmarks for
many years, with often significantly faster optimization. In addition, we show
how to use the model as part of a bits-back compression scheme, and demonstrate
lossless compression rates close to the theoretical optimum.

33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
15
The categories of this paper are: nucl-ex
0
The categories of this paper are: hep-ph
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th