Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SyncGAN: Synchronize the Latent Space of Cross-modal Generative
  Adversarial Networks   Generative adversarial network (GAN) has achieved impressive success on
cross-domain generation, but it faces difficulty in cross-modal generation due
to the lack of a common distribution between heterogeneous data. Most existing
methods of conditional based cross-modal GANs adopt the strategy of
one-directional transfer and have achieved preliminary success on text-to-image
transfer. Instead of learning the transfer between different modalities, we aim
to learn a synchronous latent space representing the cross-modal common
concept. A novel network component named synchronizer is proposed in this work
to judge whether the paired data is synchronous/corresponding or not, which can
constrain the latent space of generators in the GANs. Our GAN model, named as
SyncGAN, can successfully generate synchronous data (e.g., a pair of image and
sound) from identical random noise. For transforming data from one modality to
another, we recover the latent code by inverting the mappings of a generator
and use it to generate data of different modality. In addition, the proposed
model can achieve semi-supervised learning, which makes our model more flexible
for practical applications.

37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
3
The categories of this paper are: physics