Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ImageBART: Bidirectional Context with Multinomial Diffusion for
  Autoregressive Image Synthesis   Autoregressive models and their sequential factorization of the data
likelihood have recently demonstrated great potential for image representation
and synthesis. Nevertheless, they incorporate image context in a linear 1D
order by attending only to previously synthesized image patches above or to the
left. Not only is this unidirectional, sequential bias of attention unnatural
for images as it disregards large parts of a scene until synthesis is almost
complete. It also processes the entire image on a single scale, thus ignoring
more global contextual information up to the gist of the entire scene. As a
remedy we incorporate a coarse-to-fine hierarchy of context by combining the
autoregressive formulation with a multinomial diffusion process: Whereas a
multistage diffusion process successively removes information to coarsen an
image, we train a (short) Markov chain to invert this process. In each stage,
the resulting autoregressive ImageBART model progressively incorporates context
from previous stages in a coarse-to-fine manner. Experiments show greatly
improved image modification capabilities over autoregressive models while also
providing high-fidelity image generation, both of which are enabled through
efficient training in a compressed latent space. Specifically, our approach can
take unrestricted, user-provided masks into account to perform local image
editing. Thus, in contrast to pure autoregressive models, it can solve
free-form image inpainting and, in the case of conditional models, local,
text-guided image modification without requiring mask-specific training.

37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
18
The categories of this paper are: econ
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
30
The categories of this paper are: q-alg
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat