Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Analytical bounds on the local Lipschitz constants of affine-ReLU
  functions   In this paper, we determine analytical bounds on the local Lipschitz
constants of of affine functions composed with rectified linear units (ReLUs).
Affine-ReLU functions represent a widely used layer in deep neural networks,
due to the fact that convolution, fully-connected, and normalization functions
are all affine, and are often followed by a ReLU activation function. Using an
analytical approach, we mathematically determine upper bounds on the local
Lipschitz constant of an affine-ReLU function, show how these bounds can be
combined to determine a bound on an entire network, and discuss how the bounds
can be efficiently computed, even for larger layers and networks. We show
several examples by applying our results to AlexNet, as well as several smaller
networks based on the MNIST and CIFAR-10 datasets. The results show that our
method produces tighter bounds than the standard conservative bound (i.e. the
product of the spectral norms of the layers' linear matrices), especially for
small perturbations.

33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin