Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: How good does a Defect Predictor need to be to guide Search-Based
  Software Testing?   Defect predictors, static bug detectors and humans inspecting the code can
locate the parts of the program that are buggy before they are discovered
through testing. Automated test generators such as search-based software
testing (SBST) techniques can use this information to direct their search for
test cases to likely buggy code, thus speeding up the process of detecting
existing bugs. However, often the predictions given by these tools or humans
are imprecise, which can misguide the SBST technique and may deteriorate its
performance. In this paper, we study the impact of imprecision in defect
prediction on the bug detection effectiveness of SBST.
  Our study finds that the recall of the defect predictor, i.e., the
probability of correctly identifying buggy code, has a significant impact on
bug detection effectiveness of SBST with a large effect size. On the other
hand, the effect of precision, a measure for false alarms, is not of meaningful
practical significance as indicated by a very small effect size. In particular,
the SBST technique finds 7.5 less bugs on average (out of 420 bugs) for every
5% decrements of the recall.
  In the context of combining defect prediction and SBST, our recommendation
for practice is to increase the recall of defect predictors at the expense of
precision, while maintaining a precision of at least 75%. To account for the
imprecision of defect predictors, in particular low recall values, SBST
techniques should be designed to search for test cases that also cover the
predicted non-buggy parts of the program, while prioritising the parts that
have been predicted as buggy.

31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
26
The categories of this paper are: bayes-an
22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
27
The categories of this paper are: comp-gas