Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exploiting Twitter as Source of Large Corpora of Weakly Similar Pairs
  for Semantic Sentence Embeddings   Semantic sentence embeddings are usually supervisedly built minimizing
distances between pairs of embeddings of sentences labelled as semantically
similar by annotators. Since big labelled datasets are rare, in particular for
non-English languages, and expensive, recent studies focus on unsupervised
approaches that require not-paired input sentences. We instead propose a
language-independent approach to build large datasets of pairs of informal
texts weakly similar, without manual human effort, exploiting Twitter's
intrinsic powerful signals of relatedness: replies and quotes of tweets. We use
the collected pairs to train a Transformer model with triplet-like structures,
and we test the generated embeddings on Twitter NLP similarity tasks (PIT and
TURL) and STSb. We also introduce four new sentence ranking evaluation
benchmarks of informal texts, carefully extracted from the initial collections
of tweets, proving not only that our best model learns classical Semantic
Textual Similarity, but also excels on tasks where pairs of sentences are not
exact paraphrases. Ablation studies reveal how increasing the corpus size
influences positively the results, even at 2M samples, suggesting that bigger
collections of Tweets still do not contain redundant information about semantic
similarities.

20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
3
The categories of this paper are: physics
19
The categories of this paper are: eess
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
5
The categories of this paper are: gr-qc
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat