Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: GPU Acceleration of Sparse Neural Networks   In this paper, we use graphics processing units(GPU) to accelerate sparse and
arbitrary structured neural networks. Sparse networks have nodes in the network
that are not fully connected with nodes in preceding and following layers, and
arbitrary structure neural networks have different number of nodes in each
layers. Sparse Neural networks with arbitrary structures are generally created
in the processes like neural network pruning and evolutionary machine learning
strategies. We show that we can gain significant speedup for full activation of
such neural networks using graphical processing units. We do a prepossessing
step to determine dependency groups for all the nodes in a network, and use
that information to guide the progression of activation in the neural network.
Then we compute activation for each nodes in its own separate thread in the
GPU, which allows for massive parallelization. We use CUDA framework to
implement our approach and compare the results of sequential and GPU
implementations. Our results show that the activation of sparse neural networks
lends very well to GPU acceleration and can help speed up machine learning
strategies which generate such networks or other processes that have similar
structure.

26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
27
The categories of this paper are: comp-gas