Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Profile-guided memory optimization for deep neural networks   Recent years have seen deep neural networks (DNNs) becoming wider and deeper
to achieve better performance in many applications of AI. Such DNNs however
require huge amounts of memory to store weights and intermediate results (e.g.,
activations, feature maps, etc.) in propagation. This requirement makes it
difficult to run the DNNs on devices with limited, hard-to-extend memory,
degrades the running time performance, and restricts the design of network
models. We address this challenge by developing a novel profile-guided memory
optimization to efficiently and quickly allocate memory blocks during the
propagation in DNNs. The optimization utilizes a simple and fast heuristic
algorithm based on the two-dimensional rectangle packing problem. Experimenting
with well-known neural network models, we confirm that our method not only
reduces the memory consumption by up to $49.5\%$ but also accelerates training
and inference by up to a factor of four thanks to the rapidity of the memory
allocation and the ability to use larger mini-batch sizes.

13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
14
The categories of this paper are: math-ph
35
The categories of this paper are: mtrl-th