Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adversarial Regularization as Stackelberg Game: An Unrolled Optimization
  Approach   Adversarial regularization has been shown to improve the generalization
performance of deep learning models in various natural language processing
tasks. Existing works usually formulate the method as a zero-sum game, which is
solved by alternating gradient descent/ascent algorithms. Such a formulation
treats the adversarial and the defending players equally, which is undesirable
because only the defending player contributes to the generalization
performance. To address this issue, we propose Stackelberg Adversarial
Regularization (SALT), which formulates adversarial regularization as a
Stackelberg game. This formulation induces a competition between a leader and a
follower, where the follower generates perturbations, and the leader trains the
model subject to the perturbations. Different from conventional approaches, in
SALT, the leader is in an advantageous position. When the leader moves, it
recognizes the strategy of the follower and takes the anticipated follower's
outcomes into consideration. Such a leader's advantage enables us to improve
the model fitting to the unperturbed data. The leader's strategic information
is captured by the Stackelberg gradient, which is obtained using an unrolling
algorithm. Our experimental results on a set of machine translation and natural
language understanding tasks show that SALT outperforms existing adversarial
regularization baselines across all tasks. Our code is available at
https://github.com/SimiaoZuo/Stackelberg-Adv.

0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph