Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Temporal-aware Language Representation Learning From Crowdsourced Labels   Learning effective language representations from crowdsourced labels is
crucial for many real-world machine learning tasks. A challenging aspect of
this problem is that the quality of crowdsourced labels suffer high intra- and
inter-observer variability. Since the high-capacity deep neural networks can
easily memorize all disagreements among crowdsourced labels, directly applying
existing supervised language representation learning algorithms may yield
suboptimal solutions. In this paper, we propose \emph{TACMA}, a
\underline{t}emporal-\underline{a}ware language representation learning
heuristic for \underline{c}rowdsourced labels with \underline{m}ultiple
\underline{a}nnotators. The proposed approach (1) explicitly models the
intra-observer variability with attention mechanism; (2) computes and
aggregates per-sample confidence scores from multiple workers to address the
inter-observer disagreements. The proposed heuristic is extremely easy to
implement in around 5 lines of code. The proposed heuristic is evaluated on
four synthetic and four real-world data sets. The results show that our
approach outperforms a wide range of state-of-the-art baselines in terms of
prediction accuracy and AUC. To encourage the reproducible results, we make our
code publicly available at \url{https://github.com/CrowdsourcingMining/TACMA}.

7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
2
The categories of this paper are: math
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an