Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: GraphCode2Vec: Generic Code Embedding via Lexical and Program Dependence
  Analyses   Code embedding is a keystone in the application of machine learning on
several Software Engineering (SE) tasks. To effectively support a plethora of
SE tasks, the embedding needs to capture program syntax and semantics in a way
that is generic. To this end, we propose the first self-supervised pre-training
approach (called GraphCode2Vec) which produces task-agnostic embedding of
lexical and program dependence features. GraphCode2Vec achieves this via a
synergistic combination of code analysis and Graph Neural Networks.
GraphCode2Vec is generic, it allows pre-training, and it is applicable to
several SE downstream tasks. We evaluate the effectiveness of GraphCode2Vec on
four (4) tasks (method name prediction, solution classification, mutation
testing and overfitted patch classification), and compare it with four (4)
similarly generic code embedding baselines (Code2Seq, Code2Vec, CodeBERT,
GraphCodeBERT) and 7 task-specific, learning-based methods. In particular,
GraphCode2Vec is more effective than both generic and task-specific
learning-based baselines. It is also complementary and comparable to
GraphCodeBERT (a larger and more complex model). We also demonstrate through a
probing and ablation study that GraphCode2Vec learns lexical and program
dependence features and that self-supervised pre-training improves
effectiveness.

31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
3
The categories of this paper are: physics
0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th