Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Knowledge Infused Policy Gradients with Upper Confidence Bound for
  Relational Bandits   Contextual Bandits find important use cases in various real-life scenarios
such as online advertising, recommendation systems, healthcare, etc. However,
most of the algorithms use flat feature vectors to represent context whereas,
in the real world, there is a varying number of objects and relations among
them to model in the context. For example, in a music recommendation system,
the user context contains what music they listen to, which artists create this
music, the artist albums, etc. Adding richer relational context representations
also introduces a much larger context space making exploration-exploitation
harder. To improve the efficiency of exploration-exploitation knowledge about
the context can be infused to guide the exploration-exploitation strategy.
Relational context representations allow a natural way for humans to specify
knowledge owing to their descriptive nature. We propose an adaptation of
Knowledge Infused Policy Gradients to the Contextual Bandit setting and a novel
Knowledge Infused Policy Gradients Upper Confidence Bound algorithm and perform
an experimental analysis of a simulated music recommendation dataset and
various real-life datasets where expert knowledge can drastically reduce the
total regret and where it cannot.

20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
27
The categories of this paper are: comp-gas