Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Selective Network Linearization for Efficient Private Inference   Private inference (PI) enables inference directly on cryptographically secure
data. While promising to address many privacy issues, it has seen limited use
due to extreme runtimes. Unlike plaintext inference, where latency is dominated
by FLOPs, in PI non-linear functions (namely ReLU) are the bottleneck. Thus,
practical PI demands novel ReLU-aware optimizations. To reduce PI latency we
propose a gradient-based algorithm that selectively linearizes ReLUs while
maintaining prediction accuracy. We evaluate our algorithm on several standard
PI benchmarks. The results demonstrate up to $4.25\%$ more accuracy (iso-ReLU
count at 50K) or $2.2\times$ less latency (iso-accuracy at 70\%) than the
current state of the art and advance the Pareto frontier across the
latency-accuracy space. To complement empirical results, we present a "no free
lunch" theorem that sheds light on how and when network linearization is
possible while maintaining prediction accuracy.

6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
27
The categories of this paper are: comp-gas
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics