Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Posing Fair Generalization Tasks for Natural Language Inference   Deep learning models for semantics are generally evaluated using naturalistic
corpora. Adversarial methods, in which models are evaluated on new examples
with known semantic properties, have begun to reveal that good performance at
these naturalistic tasks can hide serious shortcomings. However, we should
insist that these evaluations be fair -that the models are given data
sufficient to support the requisite kinds of generalization. In this paper, we
define and motivate a formal notion of fairness in this sense. We then apply
these ideas to natural language inference by constructing very challenging but
provably fair artificial datasets and showing that standard neural models fail
to generalize in the required ways; only task-specific models that jointly
compose the premise and hypothesis are able to achieve high performance, and
even these models do not solve the task perfectly.

17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
14
The categories of this paper are: math-ph
3
The categories of this paper are: physics
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat