Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: DeepReDuce: ReLU Reduction for Fast Private Inference   The recent rise of privacy concerns has led researchers to devise methods for
private neural inference -- where inferences are made directly on encrypted
data, never seeing inputs. The primary challenge facing private inference is
that computing on encrypted data levies an impractically-high latency penalty,
stemming mostly from non-linear operators like ReLU. Enabling practical and
private inference requires new optimization methods that minimize network ReLU
counts while preserving accuracy. This paper proposes DeepReDuce: a set of
optimizations for the judicious removal of ReLUs to reduce private inference
latency. The key insight is that not all ReLUs contribute equally to accuracy.
We leverage this insight to drop, or remove, ReLUs from classic networks to
significantly reduce inference latency and maintain high accuracy. Given a
target network, DeepReDuce outputs a Pareto frontier of networks that tradeoff
the number of ReLUs and accuracy. Compared to the state-of-the-art for private
inference DeepReDuce improves accuracy and reduces ReLU count by up to 3.5%
(iso-ReLU count) and 3.5$\times$ (iso-accuracy), respectively.

14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
16
The categories of this paper are: stat
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics