Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Computation and Generalization of Generative Adversarial Imitation
  Learning   Generative Adversarial Imitation Learning (GAIL) is a powerful and practical
approach for learning sequential decision-making policies. Different from
Reinforcement Learning (RL), GAIL takes advantage of demonstration data by
experts (e.g., human), and learns both the policy and reward function of the
unknown environment. Despite the significant empirical progresses, the theory
behind GAIL is still largely unknown. The major difficulty comes from the
underlying temporal dependency of the demonstration data and the minimax
computational formulation of GAIL without convex-concave structure. To bridge
such a gap between theory and practice, this paper investigates the theoretical
properties of GAIL. Specifically, we show: (1) For GAIL with general reward
parameterization, the generalization can be guaranteed as long as the class of
the reward functions is properly controlled; (2) For GAIL, where the reward is
parameterized as a reproducing kernel function, GAIL can be efficiently solved
by stochastic first order optimization algorithms, which attain sublinear
convergence to a stationary solution. To the best of our knowledge, these are
the first results on statistical and computational guarantees of imitation
learning with reward/policy function approximation. Numerical experiments are
provided to support our analysis.

19
The categories of this paper are: eess
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin