Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reliable evaluation of adversarial robustness with an ensemble of
  diverse parameter-free attacks   The field of defense strategies against adversarial attacks has significantly
grown over the last years, but progress is hampered as the evaluation of
adversarial defenses is often insufficient and thus gives a wrong impression of
robustness. Many promising defenses could be broken later on, making it
difficult to identify the state-of-the-art. Frequent pitfalls in the evaluation
are improper tuning of hyperparameters of the attacks, gradient obfuscation or
masking. In this paper we first propose two extensions of the PGD-attack
overcoming failures due to suboptimal step size and problems of the objective
function. We then combine our novel attacks with two complementary existing
ones to form a parameter-free, computationally affordable and user-independent
ensemble of attacks to test adversarial robustness. We apply our ensemble to
over 50 models from papers published at recent top machine learning and
computer vision venues. In all except one of the cases we achieve lower robust
test accuracy than reported in these papers, often by more than $10\%$,
identifying several broken defenses.

3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci