Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Challenges of Context and Time in Reinforcement Learning: Introducing
  Space Fortress as a Benchmark   Research in deep reinforcement learning (RL) has coalesced around improving
performance on benchmarks like the Arcade Learning Environment. However, these
benchmarks conspicuously miss important characteristics like abrupt
context-dependent shifts in strategy and temporal sensitivity that are often
present in real-world domains. As a result, RL research has not focused on
these challenges, resulting in algorithms which do not understand critical
changes in context, and have little notion of real world time. To tackle this
issue, this paper introduces the game of Space Fortress as a RL benchmark which
incorporates these characteristics. We show that existing state-of-the-art RL
algorithms are unable to learn to play the Space Fortress game. We then confirm
that this poor performance is due to the RL algorithms' context insensitivity
and reward sparsity. We also identify independent axes along which to vary
context and temporal sensitivity, allowing Space Fortress to be used as a
testbed for understanding both characteristics in combination and also in
isolation. We release Space Fortress as an open-source Gym environment.

22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
5
The categories of this paper are: gr-qc
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math