Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fast Bayesian Optimization of Machine Learning Hyperparameters on Large
  Datasets   Bayesian optimization has become a successful tool for hyperparameter
optimization of machine learning algorithms, such as support vector machines or
deep neural networks. Despite its success, for large datasets, training and
validating a single configuration often takes hours, days, or even weeks, which
limits the achievable performance. To accelerate hyperparameter optimization,
we propose a generative model for the validation error as a function of
training set size, which is learned during the optimization process and allows
exploration of preliminary configurations on small subsets, by extrapolating to
the full dataset. We construct a Bayesian optimization procedure, dubbed
Fabolas, which models loss and training time as a function of dataset size and
automatically trades off high information gain about the global optimum against
computational cost. Experiments optimizing support vector machines and deep
neural networks show that Fabolas often finds high-quality solutions 10 to 100
times faster than other state-of-the-art Bayesian optimization methods or the
recently proposed bandit strategy Hyperband.

17
The categories of this paper are: q-fin
9
The categories of this paper are: nlin
2
The categories of this paper are: math
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
32
The categories of this paper are: atom-ph