Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Robustness from Simple Classifiers   Despite the vast success of Deep Neural Networks in numerous application
domains, it has been shown that such models are not robust i.e., they are
vulnerable to small adversarial perturbations of the input. While extensive
work has been done on why such perturbations occur or how to successfully
defend against them, we still do not have a complete understanding of
robustness. In this work, we investigate the connection between robustness and
simplicity. We find that simpler classifiers, formed by reducing the number of
output classes, are less susceptible to adversarial perturbations.
Consequently, we demonstrate that decomposing a complex multiclass model into
an aggregation of binary models enhances robustness. This behavior is
consistent across different datasets and model architectures and can be
combined with known defense techniques such as adversarial training. Moreover,
we provide further evidence of a disconnect between standard and robust
learning regimes. In particular, we show that elaborate label information can
help standard accuracy but harm robustness.

37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
4
The categories of this paper are: cond-mat
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
32
The categories of this paper are: atom-ph
25
The categories of this paper are: patt-sol