Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Why are Big Data Matrices Approximately Low Rank?   Matrices of (approximate) low rank are pervasive in data science, appearing
in recommender systems, movie preferences, topic models, medical records, and
genomics. While there is a vast literature on how to exploit low rank structure
in these datasets, there is less attention on explaining why the low rank
structure appears in the first place. Here, we explain the effectiveness of low
rank models in data science by considering a simple generative model for these
matrices: we suppose that each row or column is associated to a (possibly high
dimensional) bounded latent variable, and entries of the matrix are generated
by applying a piecewise analytic function to these latent variables. These
matrices are in general full rank. However, we show that we can approximate
every entry of an $m \times n$ matrix drawn from this model to within a fixed
absolute error by a low rank matrix whose rank grows as $\mathcal O(\log(m +
n))$. Hence any sufficiently large matrix from such a latent variable model can
be approximated, up to a small entrywise error, by a low rank matrix.

36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
35
The categories of this paper are: mtrl-th
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
5
The categories of this paper are: gr-qc