Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Linear Identifiability of Learned Representations   Identifiability is a desirable property of a statistical model: it implies
that the true model parameters may be estimated to any desired precision, given
sufficient computational resources and data. We study identifiability in the
context of representation learning: discovering nonlinear data representations
that are optimal with respect to some downstream task. When parameterized as
deep neural networks, such representation functions typically lack
identifiability in parameter space, because they are overparameterized by
design. In this paper, building on recent advances in nonlinear ICA, we aim to
rehabilitate identifiability by showing that a large family of discriminative
models are in fact identifiable in function space, up to a linear
indeterminacy. Many models for representation learning in a wide variety of
domains have been identifiable in this sense, including text, images and audio,
state-of-the-art at time of publication. We derive sufficient conditions for
linear identifiability and provide empirical support for the result on both
simulated and real-world data.

9
The categories of this paper are: nlin
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
2
The categories of this paper are: math
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
17
The categories of this paper are: q-fin