Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: InCoder: A Generative Model for Code Infilling and Synthesis   Code is seldom written in a single left-to-right pass and is instead
repeatedly edited and refined. We introduce InCoder, a unified generative model
that can perform program synthesis (via left-to-right generation) as well as
editing (via infilling). InCoder is trained to generate code files from a large
corpus of permissively licensed code, where regions of code have been randomly
masked and moved to the end of each file, allowing code infilling with
bidirectional context. Our model is the first generative model that is able to
directly perform zero-shot code infilling, which we evaluate on challenging
tasks such as type inference, comment generation, and variable re-naming. We
find that the ability to condition on bidirectional context substantially
improves performance on these tasks, while still performing comparably on
standard program synthesis benchmarks in comparison to left-to-right only
models pretrained at similar scale. The InCoder models and code are publicly
released. https://sites.google.com/view/incoder-code-models

17
The categories of this paper are: q-fin
16
The categories of this paper are: stat
13
The categories of this paper are: quant-ph
2
The categories of this paper are: math
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
5
The categories of this paper are: gr-qc
15
The categories of this paper are: nucl-ex
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
8
The categories of this paper are: hep-ex