Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Unobserved Local Structures Make Compositional Generalization Hard   While recent work has convincingly showed that sequence-to-sequence models
struggle to generalize to new compositions (termed compositional
generalization), little is known on what makes compositional generalization
hard on a particular test instance. In this work, we investigate what are the
factors that make generalization to certain test instances challenging. We
first substantiate that indeed some examples are more difficult than others by
showing that different models consistently fail or succeed on the same test
instances. Then, we propose a criterion for the difficulty of an example: a
test instance is hard if it contains a local structure that was not observed at
training time. We formulate a simple decision rule based on this criterion and
empirically show it predicts instance-level generalization well across 5
different semantic parsing datasets, substantially better than alternative
decision rules. Last, we show local structures can be leveraged for creating
difficult adversarial compositional splits and also to improve compositional
generalization under limited training budgets by strategically selecting
examples for the training set.

6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci