Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Zero-Shot Program Representation Learning   Learning program representations has been the core prerequisite of code
intelligent tasks such as code search and code clone detection. The
state-of-the-art pre-trained models such as CodeBERT require the availability
of large-scale code corpora. However, gathering training samples can be costly
and infeasible for domain-specific languages such as Solidity for smart
contracts. In this paper, we propose Zecoler, a zero-shot learning approach for
code representations. Zecoler is built upon a pre-trained programming language
model. In order to elicit knowledge from the pre-trained models efficiently,
Zecoler casts the downstream tasks to the same form of pre-training tasks by
inserting trainable prompts into the original input. Then, it employs the
prompt learning technique which optimizes the pre-trained model by merely
adjusting the original input. This enables the representation model to
efficiently fit the scarce task-oriented data while reusing pre-trained
knowledge. We evaluate Zecoler in three code intelligent tasks in two program
languages that have no training samples, namely, Solidity and Go, with model
trained in corpora of common languages such as Java. Experimental results show
that our approach significantly outperforms baseline models in both zero-shot
and few-shot settings.

27
The categories of this paper are: comp-gas
5
The categories of this paper are: gr-qc
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
16
The categories of this paper are: stat