Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning from Crowds with Sparse and Imbalanced Annotations   Traditional supervised learning requires ground truth labels for the training
data, whose collection can be difficult in many cases. Recently, crowdsourcing
has established itself as an efficient labeling solution through resorting to
non-expert crowds. To reduce the labeling error effects, one common practice is
to distribute each instance to multiple workers, whereas each worker only
annotates a subset of data, resulting in the {\it sparse annotation}
phenomenon. In this paper, we note that when meeting with class-imbalance,
i.e., when the ground truth labels are {\it class-imbalanced}, the sparse
annotations are prone to be skewly distributed, which thus can severely bias
the learning algorithm. To combat this issue, we propose one self-training
based approach named {\it Self-Crowd} by progressively adding confident
pseudo-annotations and rebalancing the annotation distribution. Specifically,
we propose one distribution aware confidence measure to select confident
pseudo-annotations, which adopts the resampling strategy to oversample the
minority annotations and undersample the majority annotations. On one
real-world crowdsourcing image classification task, we show that the proposed
method yields more balanced annotations throughout training than the
distribution agnostic methods and substantially improves the learning
performance at different annotation sparsity levels.

3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an