Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mind Your Outliers! Investigating the Negative Impact of Outliers on
  Active Learning for Visual Question Answering   Active learning promises to alleviate the massive data needs of supervised
machine learning: it has successfully improved sample efficiency by an order of
magnitude on traditional tasks like topic classification and object
recognition. However, we uncover a striking contrast to this promise: across 5
models and 4 datasets on the task of visual question answering, a wide variety
of active learning approaches fail to outperform random selection. To
understand this discrepancy, we profile 8 active learning methods on a
per-example basis, and identify the problem as collective outliers -- groups of
examples that active learning methods prefer to acquire but models fail to
learn (e.g., questions that ask about text in images or require external
knowledge). Through systematic ablation experiments and qualitative
visualizations, we verify that collective outliers are a general phenomenon
responsible for degrading pool-based active learning. Notably, we show that
active learning sample efficiency increases significantly as the number of
collective outliers in the active learning pool decreases. We conclude with a
discussion and prescriptive recommendations for mitigating the effects of these
outliers in future work.

30
The categories of this paper are: q-alg
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
32
The categories of this paper are: atom-ph
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph