Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Profiling based Out-of-core Hybrid Method for Large Neural Networks   GPUs are widely used to accelerate deep learning with NNs (NNs). On the other
hand, since GPU memory capacity is limited, it is difficult to implement
efficient programs that compute large NNs on GPU. To compute NNs exceeding GPU
memory capacity, data-swapping method and recomputing method have been proposed
in existing work. However, in these methods, performance overhead occurs due to
data movement or increase of computation. In order to reduce the overhead, it
is important to consider characteristics of each layer such as sizes and cost
for recomputation. Based on this direction, we proposed Profiling based
out-of-core Hybrid method (PoocH). PoocH determines target layers of swapping
or recomputing based on runtime profiling. We implemented PoocH by extending a
deep learning framework, Chainer, and we evaluated its performance. With PoocH,
we successfully computed an NN requiring 50 GB memory on a single GPU with 16
GB memory. Compared with in-core cases, performance degradation was 38 \% on
x86 machine and 28 \% on POWER9 machine.

4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
33
The categories of this paper are: plasm-ph