Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fast-Rate Loss Bounds via Conditional Information Measures with
  Applications to Neural Networks   We present a framework to derive bounds on the test loss of randomized
learning algorithms for the case of bounded loss functions. Drawing from
Steinke & Zakynthinou (2020), this framework leads to bounds that depend on the
conditional information density between the the output hypothesis and the
choice of the training set, given a larger set of data samples from which the
training set is formed. Furthermore, the bounds pertain to the average test
loss as well as to its tail probability, both for the PAC-Bayesian and the
single-draw settings. If the conditional information density is bounded
uniformly in the size $n$ of the training set, our bounds decay as $1/n$. This
is in contrast with the tail bounds involving conditional information measures
available in the literature, which have a less benign $1/\sqrt{n}$ dependence.
We demonstrate the usefulness of our tail bounds by showing that they lead to
nonvacuous estimates of the test loss achievable with some neural network
architectures trained on MNIST and Fashion-MNIST.

18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
35
The categories of this paper are: mtrl-th
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int