Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Positional Encoding to Control Output Sequence Length   Neural encoder-decoder models have been successful in natural language
generation tasks. However, real applications of abstractive summarization must
consider additional constraint that a generated summary should not exceed a
desired length. In this paper, we propose a simple but effective extension of a
sinusoidal positional encoding (Vaswani et al., 2017) to enable neural
encoder-decoder model to preserves the length constraint. Unlike in previous
studies where that learn embeddings representing each length, the proposed
method can generate a text of any length even if the target length is not
present in training data. The experimental results show that the proposed
method can not only control the generation length but also improve the ROUGE
scores.

25
The categories of this paper are: patt-sol
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
31
The categories of this paper are: ao-sci
27
The categories of this paper are: comp-gas
23
The categories of this paper are: solv-int