Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Arithmetic-Intensity-Guided Fault Tolerance for Neural Network Inference
  on GPUs   Neural networks (NNs) are increasingly employed in safety-critical domains
and in environments prone to unreliability (e.g., soft errors), such as on
spacecraft. Therefore, it is critical to impart fault tolerance to NN
inference. Algorithm-based fault tolerance (ABFT) is emerging as an efficient
approach for fault tolerance in NNs.
  We propose an adaptive approach to ABFT for NN inference that exploits
untapped opportunities in emerging deployment scenarios. GPUs have high
compute-to-memory-bandwidth ratios, while NN layers have a wide range of
arithmetic intensities. This leaves some layers compute bound and others
memory-bandwidth bound, but current approaches to ABFT do not consider these
differences. We first investigate ABFT schemes best suited for each of these
scenarios. We then propose intensity-guided ABFT, an adaptive,
arithmetic-intensity-guided approach that selects the most efficient ABFT
scheme for each NN layer. Intensity-guided ABFT reduces execution-time overhead
by 1.09--5.3$\times$ across many NNs compared to traditional approaches to
ABFT.

23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
2
The categories of this paper are: math
5
The categories of this paper are: gr-qc
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
0
The categories of this paper are: hep-ph
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg