Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning to Optimize Join Queries With Deep Reinforcement Learning   Exhaustive enumeration of all possible join orders is often avoided, and most
optimizers leverage heuristics to prune the search space. The design and
implementation of heuristics are well-understood when the cost model is roughly
linear, and we find that these heuristics can be significantly suboptimal when
there are non-linearities in cost. Ideally, instead of a fixed heuristic, we
would want a strategy to guide the search space in a more data-driven
way---tailoring the search to a specific dataset and query workload.
Recognizing the link between classical Dynamic Programming enumeration methods
and recent results in Reinforcement Learning (RL), we propose a new method for
learning optimized join search strategies. We present our RL-based DQ
optimizer, which currently optimizes select-project-join blocks. We implement
three versions of DQ to illustrate the ease of integration into existing
DBMSes: (1) A version built on top of Apache Calcite, (2) a version integrated
into PostgreSQL, and (3) a version integrated into SparkSQL. Our extensive
evaluation shows that DQ achieves plans with optimization costs and query
execution times competitive with the native query optimizer in each system, but
can execute significantly faster after learning (often by orders of magnitude).

8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
2
The categories of this paper are: math