Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Rateless Codes for Near-Perfect Load Balancing in Distributed
  Matrix-Vector Multiplication   Large-scale machine learning and data mining applications require computer
systems to perform massive matrix-vector and matrix-matrix multiplication
operations that need to be parallelized across multiple nodes. The presence of
straggling nodes -- computing nodes that unpredictably slowdown or fail -- is a
major bottleneck in such distributed computations. Ideal load balancing
strategies that dynamically allocate more tasks to faster nodes require
knowledge or monitoring of node speeds as well as the ability to quickly move
data. Recently proposed fixed-rate erasure coding strategies can handle
unpredictable node slowdown, but they ignore partial work done by straggling
nodes thus resulting in a lot of redundant computation. We propose a
\emph{rateless fountain coding} strategy that achieves the best of both worlds
-- we prove that its latency is asymptotically equal to ideal load balancing,
and it performs asymptotically zero redundant computations. Our idea is to
create linear combinations of the $m$ rows of the matrix and assign these
encoded rows to different worker nodes. The original matrix-vector product can
be decoded as soon as slightly more than $m$ row-vector products are
collectively finished by the nodes. We conduct experiments in three computing
environments: local parallel computing, Amazon EC2, and Amazon Lambda, which
show that rateless coding gives as much as $3\times$ speed-up over uncoded
schemes.

31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
16
The categories of this paper are: stat
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph