Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: FutureGAN: Anticipating the Future Frames of Video Sequences using
  Spatio-Temporal 3d Convolutions in Progressively Growing GANs   We introduce a new encoder-decoder GAN model, FutureGAN, that predicts future
frames of a video sequence conditioned on a sequence of past frames. During
training, the networks solely receive the raw pixel values as an input, without
relying on additional constraints or dataset specific conditions. To capture
both the spatial and temporal components of a video sequence, spatio-temporal
3d convolutions are used in all encoder and decoder modules. Further, we
utilize concepts of the existing progressively growing GAN (PGGAN) that
achieves high-quality results on generating high-resolution single images. The
FutureGAN model extends this concept to the complex task of video prediction.
We conducted experiments on three different datasets, MovingMNIST, KTH Action,
and Cityscapes. Our results show that the model learned representations to
transform the information of an input sequence into a plausible future sequence
effectively for all three datasets. The main advantage of the FutureGAN
framework is that it is applicable to various different datasets without
additional changes, whilst achieving stable results that are competitive to the
state-of-the-art in video prediction. Our code is available at
https://github.com/TUM-LMF/FutureGAN.

23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol