Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modeling Vocabulary for Big Code Machine Learning   When building machine learning models that operate on source code, several
decisions have to be made to model source-code vocabulary. These decisions can
have a large impact: some can lead to not being able to train models at all,
others significantly affect performance, particularly for Neural Language
Models. Yet, these decisions are not often fully described. This paper lists
important modeling choices for source code vocabulary, and explores their
impact on the resulting vocabulary on a large-scale corpus of 14,436 projects.
We show that a subset of decisions have decisive characteristics, allowing to
train accurate Neural Language Models quickly on a large corpus of 10,106
projects.

37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org