Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modeling the Second Player in Distributionally Robust Optimization   Distributionally robust optimization (DRO) provides a framework for training
machine learning models that are able to perform well on a collection of
related data distributions (the "uncertainty set"). This is done by solving a
min-max game: the model is trained to minimize its maximum expected loss among
all distributions in the uncertainty set. While careful design of the
uncertainty set is critical to the success of the DRO procedure, previous work
has been limited to relatively simple alternatives that keep the min-max
optimization problem exactly tractable, such as $f$-divergence balls. In this
paper, we argue instead for the use of neural generative models to characterize
the worst-case distribution, allowing for more flexible and problem-specific
selection of the uncertainty set. However, while simple conceptually, this
approach poses a number of implementation and optimization challenges. To
circumvent these issues, we propose a relaxation of the KL-constrained inner
maximization objective that makes the DRO problem more amenable to
gradient-based optimization of large scale generative models, and develop model
selection heuristics to guide hyper-parameter search. On both toy settings and
realistic NLP tasks, we find that the proposed approach yields models that are
more robust than comparable baselines.

13
The categories of this paper are: quant-ph
24
The categories of this paper are: dg-ga
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph