Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Controllable Text-to-Image Generation   In this paper, we propose a novel controllable text-to-image generative
adversarial network (ControlGAN), which can effectively synthesise high-quality
images and also control parts of the image generation according to natural
language descriptions. To achieve this, we introduce a word-level spatial and
channel-wise attention-driven generator that can disentangle different visual
attributes, and allow the model to focus on generating and manipulating
subregions corresponding to the most relevant words. Also, a word-level
discriminator is proposed to provide fine-grained supervisory feedback by
correlating words with image regions, facilitating training an effective
generator which is able to manipulate specific visual attributes without
affecting the generation of other content. Furthermore, perceptual loss is
adopted to reduce the randomness involved in the image generation, and to
encourage the generator to manipulate specific attributes required in the
modified text. Extensive experiments on benchmark datasets demonstrate that our
method outperforms existing state of the art, and is able to effectively
manipulate synthetic images using natural language descriptions. Code is
available at https://github.com/mrlibw/ControlGAN.

26
The categories of this paper are: bayes-an
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th