Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adaptive Verifiable Training Using Pairwise Class Similarity   Verifiable training has shown success in creating neural networks that are
provably robust to a given amount of noise. However, despite only enforcing a
single robustness criterion, its performance scales poorly with dataset
complexity. On CIFAR10, a non-robust LeNet model has a 21.63% error rate, while
a model created using verifiable training and a L-infinity robustness criterion
of 8/255, has an error rate of 57.10%. Upon examination, we find that when
labeling visually similar classes, the model's error rate is as high as 61.65%.
We attribute the loss in performance to inter-class similarity. Similar classes
(i.e., close in the feature space) increase the difficulty of learning a robust
model. While it's desirable to train a robust model for a large robustness
region, pairwise class similarities limit the potential gains. Also,
consideration must be made regarding the relative cost of mistaking similar
classes. In security or safety critical tasks, similar classes are likely to
belong to the same group, and thus are equally sensitive.
  In this work, we propose a new approach that utilizes inter-class similarity
to improve the performance of verifiable training and create robust models with
respect to multiple adversarial criteria. First, we use agglomerate clustering
to group similar classes and assign robustness criteria based on the similarity
between clusters. Next, we propose two methods to apply our approach: (1)
Inter-Group Robustness Prioritization, which uses a custom loss term to create
a single model with multiple robustness guarantees and (2) neural decision
trees, which trains multiple sub-classifiers with different robustness
guarantees and combines them in a decision tree architecture. On Fashion-MNIST
and CIFAR10, our approach improves clean performance by 9.63% and 30.89%
respectively. On CIFAR100, our approach improves clean performance by 26.32%.

31
The categories of this paper are: ao-sci
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
14
The categories of this paper are: math-ph
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat