Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reusing Trained Layers of Convolutional Neural Networks to Shorten
  Hyperparameters Tuning Time   Hyperparameters tuning is a time-consuming approach, particularly when the
architecture of the neural network is decided as part of this process. For
instance, in convolutional neural networks (CNNs), the selection of the number
and the characteristics of the hidden (convolutional) layers may be decided.
This implies that the search process involves the training of all these
candidate network architectures.
  This paper describes a proposal to reuse the weights of hidden
(convolutional) layers among different trainings to shorten this process. The
rationale is that if a set of convolutional layers have been trained to solve a
given problem, the weights calculated in this training may be useful when a new
convolutional layer is added to the network architecture.
  This idea has been tested using the CIFAR-10 dataset, testing different CNNs
architectures with up to 3 convolutional layers and up to 3 fully connected
layers. The experiments compare the training time and the validation loss when
reusing and not reusing convolutional layers. They confirm that this strategy
reduces the training time while it even increases the accuracy of the resulting
neural network. This finding opens up the future possibility of integrating
this strategy in existing AutoML methods with the purpose of reducing the total
search time.

9
The categories of this paper are: nlin
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc