Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Image Generation from Layout   Despite significant recent progress on generative models, controlled
generation of images depicting multiple and complex object layouts is still a
difficult problem. Among the core challenges are the diversity of appearance a
given object may possess and, as a result, exponential set of images consistent
with a specified layout. To address these challenges, we propose a novel
approach for layout-based image generation; we call it Layout2Im. Given the
coarse spatial layout (bounding boxes + object categories), our model can
generate a set of realistic images which have the correct objects in the
desired locations. The representation of each object is disentangled into a
specified/certain part (category) and an unspecified/uncertain part
(appearance). The category is encoded using a word embedding and the appearance
is distilled into a low-dimensional vector sampled from a normal distribution.
Individual object representations are composed together using convolutional
LSTM, to obtain an encoding of the complete layout, and then decoded to an
image. Several loss terms are introduced to encourage accurate and diverse
generation. The proposed Layout2Im model significantly outperforms the previous
state of the art, boosting the best reported inception score by 24.66% and
28.57% on the very challenging COCO-Stuff and Visual Genome datasets,
respectively. Extensive experiments also demonstrate our method's ability to
generate complex and diverse images with multiple objects.

28
The categories of this paper are: alg-geom
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
23
The categories of this paper are: solv-int