Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Practical Size-based Scheduling for MapReduce Workloads   We present the Hadoop Fair Sojourn Protocol (HFSP) scheduler, which
implements a size-based scheduling discipline for Hadoop. The benefits of
size-based scheduling disciplines are well recognized in a variety of contexts
(computer networks, operating systems, etc...), yet, their practical
implementation for a system such as Hadoop raises a number of important
challenges. With HFSP, which is available as an open-source project, we address
issues related to job size estimation, resource management and study the
effects of a variety of preemption strategies. Although the architecture
underlying HFSP is suitable for any size-based scheduling discipline, in this
work we revisit and extend the Fair Sojourn Protocol, which solves problems
related to job starvation that affect FIFO, Processor Sharing and a range of
size-based disciplines. Our experiments, in which we compare HFSP to standard
Hadoop schedulers, pinpoint at a significant decrease in average job sojourn
times - a metric that accounts for the total time a job spends in the system,
including waiting and serving times - for realistic workloads that we generate
according to production traces available in literature.

25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an
35
The categories of this paper are: mtrl-th
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an