Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: BanditRank: Learning to Rank Using Contextual Bandits   We propose an extensible deep learning method that uses reinforcement
learning to train neural networks for offline ranking in information retrieval
(IR). We call our method BanditRank as it treats ranking as a contextual bandit
problem. In the domain of learning to rank for IR, current deep learning models
are trained on objective functions different from the measures they are
evaluated on. Since most evaluation measures are discrete quantities, they
cannot be leveraged by directly using gradient descent algorithms without an
approximation. BanditRank bridges this gap by directly optimizing a
task-specific measure, such as mean average precision (MAP), using gradient
descent. Specifically, a contextual bandit whose action is to rank input
documents is trained using a policy gradient algorithm to directly maximize the
reward. The reward can be a single measure, such as MAP, or a combination of
several measures. The notion of ranking is also inherent in BanditRank, similar
to the current \textit{listwise} approaches. To evaluate the effectiveness of
BanditRank, we conducted a series of experiments on datasets related to three
different tasks, i.e., web search, community, and factoid question answering.
We found that it performs better than state-of-the-art methods when applied on
the question answering datasets. On the web search dataset, we found that
BanditRank performed better than four strong listwise baselines including
LambdaMART, AdaRank, ListNet and Coordinate Ascent.

8
The categories of this paper are: hep-ex
24
The categories of this paper are: dg-ga
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
15
The categories of this paper are: nucl-ex