Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Singularity: Planet-Scale, Preemptive and Elastic Scheduling of AI
  Workloads   Lowering costs by driving high utilization across deep learning workloads is
a crucial lever for cloud providers. We present Singularity, Microsoft's
globally distributed scheduling service for highly-efficient and reliable
execution of deep learning training and inference workloads. At the heart of
Singularity is a novel, workload-aware scheduler that can transparently preempt
and elastically scale deep learning workloads to drive high utilization without
impacting their correctness or performance, across a global fleet of AI
accelerators (e.g., GPUs, FPGAs).
  All jobs in Singularity are preemptable, migratable, and dynamically
resizable (elastic) by default: a live job can be dynamically and transparently
(a) preempted and migrated to a different set of nodes, cluster, data center or
a region and resumed exactly from the point where the execution was preempted,
and (b) resized (i.e., elastically scaled-up/down) on a varying set of
accelerators of a given type. Our mechanisms are transparent in that they do
not require the user to make any changes to their code or require using any
custom libraries that may limit flexibility. Additionally, our approach
significantly improves the reliability of deep learning workloads. We show that
the resulting efficiency and reliability gains with Singularity are achieved
with negligible impact on the steady-state performance. Finally, our design
approach is agnostic of DNN architectures and handles a variety of parallelism
strategies (e.g., data/pipeline/model parallelism).

37
The categories of this paper are: supr-con
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
19
The categories of this paper are: eess
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio