Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Simulating Bandit Learning from User Feedback for Extractive Question
  Answering   We study learning from user feedback for extractive question answering by
simulating feedback using supervised data. We cast the problem as contextual
bandit learning, and analyze the characteristics of several learning scenarios
with focus on reducing data annotation. We show that systems initially trained
on a small number of examples can dramatically improve given feedback from
users on model-predicted answers, and that one can use existing datasets to
deploy systems in new domains without any annotation, but instead improving the
system on-the-fly via user feedback.

15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th