Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: DynIMS: A Dynamic Memory Controller for In-memory Storage on HPC Systems   In order to boost the performance of data-intensive computing on HPC systems,
in-memory computing frameworks, such as Apache Spark and Flink, use local DRAM
for data storage. Optimizing the memory allocation to data storage is critical
to delivering performance to traditional HPC compute jobs and throughput to
data-intensive applications sharing the HPC resources. Current practices that
statically configure in-memory storage may leave inadequate space for compute
jobs or lose the opportunity to utilize more available space for data-intensive
applications. In this paper, we explore techniques to dynamically adjust
in-memory storage and make the right amount of space for compute jobs. We have
developed a dynamic memory controller, DynIMS, which infers memory demands of
compute tasks online and employs a feedback-based control model to adapt the
capacity of in-memory storage. We test DynIMS using mixed HPCC and Spark
workloads on a HPC cluster. Experimental results show that DynIMS can achieve
up to 5X performance improvement compared to systems with static memory
allocations.

22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
29
The categories of this paper are: funct-an
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th