Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Assessing incrementality in sequence-to-sequence models   Since their inception, encoder-decoder models have successfully been applied
to a wide array of problems in computational linguistics. The most recent
successes are predominantly due to the use of different variations of attention
mechanisms, but their cognitive plausibility is questionable. In particular,
because past representations can be revisited at any point in time,
attention-centric methods seem to lack an incentive to build up incrementally
more informative representations of incoming sentences. This way of processing
stands in stark contrast with the way in which humans are believed to process
language: continuously and rapidly integrating new information as it is
encountered. In this work, we propose three novel metrics to assess the
behavior of RNNs with and without an attention mechanism and identify key
differences in the way the different model types process sentences.

22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
3
The categories of this paper are: physics
24
The categories of this paper are: dg-ga
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ