Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Speeding up the Hyperparameter Optimization of Deep Convolutional Neural
  Networks   Most learning algorithms require the practitioner to manually set the values
of many hyperparameters before the learning process can begin. However, with
modern algorithms, the evaluation of a given hyperparameter setting can take a
considerable amount of time and the search space is often very
high-dimensional. We suggest using a lower-dimensional representation of the
original data to quickly identify promising areas in the hyperparameter space.
This information can then be used to initialize the optimization algorithm for
the original, higher-dimensional data. We compare this approach with the
standard procedure of optimizing the hyperparameters only on the original
input.
  We perform experiments with various state-of-the-art hyperparameter
optimization algorithms such as random search, the tree of parzen estimators
(TPEs), sequential model-based algorithm configuration (SMAC), and a genetic
algorithm (GA). Our experiments indicate that it is possible to speed up the
optimization process by using lower-dimensional data representations at the
beginning, while increasing the dimensionality of the input later in the
optimization process. This is independent of the underlying optimization
procedure, making the approach promising for many existing hyperparameter
optimization algorithms.

31
The categories of this paper are: ao-sci
7
The categories of this paper are: hep-th
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
25
The categories of this paper are: patt-sol