Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in
  SystemML   Many large-scale machine learning (ML) systems allow specifying custom ML
algorithms by means of linear algebra programs, and then automatically generate
efficient execution plans. In this context, optimization opportunities for
fused operators---in terms of fused chains of basic operators---are ubiquitous.
These opportunities include (1) fewer materialized intermediates, (2) fewer
scans of input data, and (3) the exploitation of sparsity across chains of
operators. Automatic operator fusion eliminates the need for hand-written fused
operators and significantly improves performance for complex or previously
unseen chains of operations. However, existing fusion heuristics struggle to
find good fusion plans for complex DAGs or hybrid plans of local and
distributed operations. In this paper, we introduce an optimization framework
for systematically reason about fusion plans that considers materialization
points in DAGs, sparsity exploitation, different fusion template types, as well
as local and distributed operations. In detail, we contribute algorithms for
(1) candidate exploration of valid fusion plans, (2) cost-based candidate
selection, and (3) code generation of local and distributed operations over
dense, sparse, and compressed data. Our experiments in SystemML show end-to-end
performance improvements with optimized fusion plans of up to 21x compared to
hand-written fused operators, with negligible optimization and code generation
overhead.

14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph