Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Compressing DMA Engine: Leveraging Activation Sparsity for Training Deep
  Neural Networks   Popular deep learning frameworks require users to fine-tune their memory
usage so that the training data of a deep neural network (DNN) fits within the
GPU physical memory. Prior work tries to address this restriction by
virtualizing the memory usage of DNNs, enabling both CPU and GPU memory to be
utilized for memory allocations. Despite its merits, virtualizing memory can
incur significant performance overheads when the time needed to copy data back
and forth from CPU memory is higher than the latency to perform the
computations required for DNN forward and backward propagation. We introduce a
high-performance virtualization strategy based on a "compressing DMA engine"
(cDMA) that drastically reduces the size of the data structures that are
targeted for CPU-side allocations. The cDMA engine offers an average 2.6x
(maximum 13.8x) compression ratio by exploiting the sparsity inherent in
offloaded data, improving the performance of virtualized DNNs by an average 32%
(maximum 61%).

32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga
25
The categories of this paper are: patt-sol
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
28
The categories of this paper are: alg-geom
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph