Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Angular-Based Word Meta-Embedding Learning   Ensembling word embeddings to improve distributed word representations has
shown good success for natural language processing tasks in recent years. These
approaches either carry out straightforward mathematical operations over a set
of vectors or use unsupervised learning to find a lower-dimensional
representation. This work compares meta-embeddings trained for different
losses, namely loss functions that account for angular distance between the
reconstructed embedding and the target and those that account normalized
distances based on the vector length. We argue that meta-embeddings are better
to treat the ensemble set equally in unsupervised learning as the respective
quality of each embedding is unknown for upstream tasks prior to
meta-embedding. We show that normalization methods that account for this such
as cosine and KL-divergence objectives outperform meta-embedding trained on
standard $\ell_1$ and $\ell_2$ loss on \textit{defacto} word similarity and
relatedness datasets and find it outperforms existing meta-learning strategies.

29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
19
The categories of this paper are: eess
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
7
The categories of this paper are: hep-th
3
The categories of this paper are: physics
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
32
The categories of this paper are: atom-ph