Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: What to Learn, and How: Toward Effective Learning from Rationales   Learning from rationales seeks to augment model prediction accuracy using
human-annotated rationales (i.e. subsets of input tokens) that justify their
chosen labels, often in the form of intermediate or multitask supervision.
While intuitive, this idea has proven elusive in practice. We make two
observations about human rationales via empirical analyses: 1) maximizing
rationale supervision accuracy is not necessarily the optimal objective for
improving model accuracy; 2) human rationales vary in whether they provide
sufficient information for the model to exploit for prediction. Building on
these insights, we propose several novel loss functions and learning
strategies, and evaluate their effectiveness on three datasets with human
rationales. Our results demonstrate consistent improvements over baselines in
both label and rationale accuracy, including a 3% accuracy improvement on
MultiRC. Our work highlights the importance of understanding properties of
human explanations and exploiting them accordingly in model training.

10
The categories of this paper are: q-bio
6
The categories of this paper are: astro-ph
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
21
The categories of this paper are: adap-org