Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Transfer of Temporal Logic Formulas in Reinforcement Learning   Transferring high-level knowledge from a source task to a target task is an
effective way to expedite reinforcement learning (RL). For example,
propositional logic and first-order logic have been used as representations of
such knowledge. We study the transfer of knowledge between tasks in which the
timing of the events matters. We call such tasks temporal tasks. We concretize
similarity between temporal tasks through a notion of logical transferability,
and develop a transfer learning approach between different yet similar temporal
tasks. We first propose an inference technique to extract metric interval
temporal logic (MITL) formulas in sequential disjunctive normal form from
labeled trajectories collected in RL of the two tasks. If logical
transferability is identified through this inference, we construct a timed
automaton for each sequential conjunctive subformula of the inferred MITL
formulas from both tasks. We perform RL on the extended state which includes
the locations and clock valuations of the timed automata for the source task.
We then establish mappings between the corresponding components (clocks,
locations, etc.) of the timed automata from the two tasks, and transfer the
extended Q-functions based on the established mappings. Finally, we perform RL
on the extended state for the target task, starting with the transferred
extended Q-functions. Our results in two case studies show, depending on how
similar the source task and the target task are, that the sampling efficiency
for the target task can be improved by up to one order of magnitude by
performing RL in the extended state space, and further improved by up to
another order of magnitude using the transferred extended Q-functions.

2
The categories of this paper are: math
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys