Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards Nonlinear Disentanglement in Natural Data with Temporal Sparse
  Coding   We construct an unsupervised learning model that achieves nonlinear
disentanglement of underlying factors of variation in naturalistic videos.
Previous work suggests that representations can be disentangled if all but a
few factors in the environment stay constant at any point in time. As a result,
algorithms proposed for this problem have only been tested on carefully
constructed datasets with this exact property, leaving it unclear whether they
will transfer to natural scenes. Here we provide evidence that objects in
segmented natural movies undergo transitions that are typically small in
magnitude with occasional large jumps, which is characteristic of a temporally
sparse distribution. We leverage this finding and present SlowVAE, a model for
unsupervised representation learning that uses a sparse prior on temporally
adjacent observations to disentangle generative factors without any assumptions
on the number of changing factors. We provide a proof of identifiability and
show that the model reliably learns disentangled representations on several
established benchmark datasets, often surpassing the current state-of-the-art.
We additionally demonstrate transferability towards video datasets with natural
dynamics, Natural Sprites and KITTI Masks, which we contribute as benchmarks
for guiding disentanglement research towards more natural data domains.

11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int