Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: The Effect of Downstream Classification Tasks for Evaluating Sentence
  Embeddings   One popular method for quantitatively evaluating the utility of sentence
embeddings involves using them in downstream language processing tasks that
require sentence representations as input. One simple such task is
classification, where the sentence representations are used to train and test
models on several classification datasets. We argue that by evaluating sentence
representations in such a manner, the goal of the representations becomes
learning a low-dimensional factorization of a sentence-task label matrix. We
show how characteristics of this matrix can affect the ability for a
low-dimensional factorization to perform as sentence representations in a suite
of classification tasks. Primarily, sentences that have more labels across all
possible classification tasks have a higher reconstruction loss, however the
general nature of this effect is ultimately dependent on the overall
distribution of labels across all possible sentences.

16
The categories of this paper are: stat
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph