Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Assurances in Software Testing: A Roadmap   As researchers, we already understand how to make testing more effective and
efficient at finding bugs. However, as fuzzing (i.e., automated testing)
becomes more widely adopted in practice, practitioners are asking: Which
assurances does a fuzzing campaign provide that exposes no bugs? When is it
safe to stop the fuzzer with a reasonable residual risk? How much longer should
the fuzzer be run to achieve sufficient coverage?
  It is time for us to move beyond the innovation of increasingly sophisticated
testing techniques, to build a body of knowledge around the explication and
quantification of the testing process, and to develop sound methodologies to
estimate and extrapolate these quantities with measurable accuracy. In our
vision of the future practitioners leverage a rich statistical toolset to
assess residual risk, to obtain statistical guarantees, and to analyze the
cost-benefit trade-off for ongoing fuzzing campaigns. We propose a general
framework as a first starting point to tackle this fundamental challenge and
discuss a large number of concrete opportunities for future research.

19
The categories of this paper are: eess
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
27
The categories of this paper are: comp-gas
17
The categories of this paper are: q-fin
32
The categories of this paper are: atom-ph
34
The categories of this paper are: chem-ph
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math