Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: An Empirical Study on Benchmarks of Artificial Software Vulnerabilities   Recently, various techniques (e.g., fuzzing) have been developed for
vulnerability detection. To evaluate those techniques, the community has been
developing benchmarks of artificial vulnerabilities because of a shortage of
ground-truth. However, people have concerns that such vulnerabilities cannot
represent reality and may lead to unreliable and misleading results.
Unfortunately, there lacks research on handling such concerns.
  In this work, to understand how close these benchmarks mirror reality, we
perform an empirical study on three artificial vulnerability benchmarks -
LAVA-M, Rode0day and CGC (2669 bugs) and various real-world memory-corruption
vulnerabilities (80 CVEs). Furthermore, we propose a model to depict the
properties of memory-corruption vulnerabilities. Following this model, we
conduct intensive experiments and data analyses. Our analytic results reveal
that while artificial benchmarks attempt to approach the real world, they still
significantly differ from reality. Based on the findings, we propose a set of
strategies to improve the quality of artificial benchmarks.

10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex