Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Plumber: Diagnosing and Removing Performance Bottlenecks in Machine
  Learning Data Pipelines   Input pipelines, which ingest and transform input data, are an essential part
of training Machine Learning (ML) models. However, it is challenging to
implement efficient input pipelines, as it requires reasoning about
parallelism, asynchrony, and variability in fine-grained profiling information.
Our analysis of over two million ML jobs in Google datacenters reveals that a
significant fraction of model training jobs could benefit from faster input
data pipelines. At the same time, our analysis indicates that most jobs do not
saturate host hardware, pointing in the direction of software-based
bottlenecks. Motivated by these findings, we propose Plumber, a tool for
finding bottlenecks in ML input pipelines. Plumber uses an extensible and
interpretable operational analysis analytical model to automatically tune
parallelism, prefetching, and caching under host resource constraints. Across
five representative ML pipelines, Plumber obtains speedups of up to 47x for
misconfigured pipelines. By automating caching, Plumber obtains end-to-end
speedups of over 50% compared to state-of-the-art tuners.

19
The categories of this paper are: eess
30
The categories of this paper are: q-alg
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
2
The categories of this paper are: math
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
24
The categories of this paper are: dg-ga