Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: An Evalutation of Programming Language Models' performance on Software
  Defect Detection   This dissertation presents an evaluation of several language models on
software defect datasets. A language Model (LM) "can provide word
representation and probability indication of word sequences as the core
component of an NLP system." Language models for source code are specified for
tasks in the software engineering field. While some models are directly the NLP
ones, others contain structural information that is uniquely owned by source
code. Software defects are defects in the source code that lead to unexpected
behaviours and malfunctions at all levels. This study provides an original
attempt to detect these defects at three different levels (syntactical,
algorithmic and general) We also provide a tool chain that researchers can use
to reproduce the experiments. We have tested the different models against
different datasets, and performed an analysis over the results. Our original
attempt to deploy bert, the state-of-the-art model for multitasks, leveled or
outscored all other models compared.

15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int