Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Hoplite: Efficient and Fault-Tolerant Collective Communication for
  Task-Based Distributed Systems   Task-based distributed frameworks (e.g., Ray, Dask, Hydro) have become
increasingly popular for distributed applications that contain asynchronous and
dynamic workloads, including asynchronous gradient descent, reinforcement
learning, and model serving. As more data-intensive applications move to run on
top of task-based systems, collective communication efficiency has become an
important problem. Unfortunately, traditional collective communication
libraries (e.g., MPI, Horovod, NCCL) are an ill fit, because they require the
communication schedule to be known before runtime and they do not provide fault
tolerance.
  We design and implement Hoplite, an efficient and fault-tolerant collective
communication layer for task-based distributed systems. Our key technique is to
compute data transfer schedules on the fly and execute the schedules
efficiently through fine-grained pipelining. At the same time, when a task
fails, the data transfer schedule adapts quickly to allow other tasks to keep
making progress. We apply Hoplite to a popular task-based distributed
framework, Ray. We show that Hoplite speeds up asynchronous stochastic gradient
descent, reinforcement learning, and serving an ensemble of machine learning
models that are difficult to execute efficiently with traditional collective
communication by up to 7.8x, 3.9x, and 3.3x, respectively.

16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
11
The categories of this paper are: hep-lat