Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Practical Privacy Filters and Odometers with R\'enyi Differential
  Privacy and Applications to Differentially Private Deep Learning   Differential Privacy (DP) is the leading approach to privacy preserving deep
learning. As such, there are multiple efforts to provide drop-in integration of
DP into popular frameworks. These efforts, which add noise to each gradient
computation to make it DP, rely on composition theorems to bound the total
privacy loss incurred over this sequence of DP computations.
  However, existing composition theorems present a tension between efficiency
and flexibility. Most theorems require all computations in the sequence to have
a predefined DP parameter, called the privacy budget. This prevents the design
of training algorithms that adapt the privacy budget on the fly, or that
terminate early to reduce the total privacy loss. Alternatively, the few
existing composition results for adaptive privacy budgets provide complex
bounds on the privacy loss, with constants too large to be practical.
  In this paper, we study DP composition under adaptive privacy budgets through
the lens of R\'enyi Differential Privacy, proving a simpler composition theorem
with smaller constants, making it practical enough to use in algorithm design.
We demonstrate two applications of this theorem for DP deep learning: adapting
the noise or batch size online to improve a model's accuracy within a fixed
total privacy loss, and stopping early when fine-tuning a model to reduce total
privacy loss.

10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol