Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ModelCI-e: Enabling Continual Learning in Deep Learning Serving Systems   MLOps is about taking experimental ML models to production, i.e., serving the
models to actual users. Unfortunately, existing ML serving systems do not
adequately handle the dynamic environments in which online data diverges from
offline training data, resulting in tedious model updating and deployment
works. This paper implements a lightweight MLOps plugin, termed ModelCI-e
(continuous integration and evolution), to address the issue. Specifically, it
embraces continual learning (CL) and ML deployment techniques, providing
end-to-end supports for model updating and validation without serving engine
customization. ModelCI-e includes 1) a model factory that allows CL researchers
to prototype and benchmark CL models with ease, 2) a CL backend to automate and
orchestrate the model updating efficiently, and 3) a web interface for an ML
team to manage CL service collaboratively. Our preliminary results demonstrate
the usability of ModelCI-e, and indicate that eliminating the interference
between model updating and inference workloads is crucial for higher system
efficiency.

14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
37
The categories of this paper are: supr-con
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
5
The categories of this paper are: gr-qc