Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Insertion-Deletion Transformer   We propose the Insertion-Deletion Transformer, a novel transformer-based
neural architecture and training method for sequence generation. The model
consists of two phases that are executed iteratively, 1) an insertion phase and
2) a deletion phase. The insertion phase parameterizes a distribution of
insertions on the current output hypothesis, while the deletion phase
parameterizes a distribution of deletions over the current output hypothesis.
The training method is a principled and simple algorithm, where the deletion
model obtains its signal directly on-policy from the insertion model output. We
demonstrate the effectiveness of our Insertion-Deletion Transformer on
synthetic translation tasks, obtaining significant BLEU score improvement over
an insertion-only model.

23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph