Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Curriculum Dropout   Dropout is a very effective way of regularizing neural networks.
Stochastically "dropping out" units with a certain probability discourages
over-specific co-adaptations of feature detectors, preventing overfitting and
improving network generalization. Besides, Dropout can be interpreted as an
approximate model aggregation technique, where an exponential number of smaller
networks are averaged in order to get a more powerful ensemble. In this paper,
we show that using a fixed dropout probability during training is a suboptimal
choice. We thus propose a time scheduling for the probability of retaining
neurons in the network. This induces an adaptive regularization scheme that
smoothly increases the difficulty of the optimization problem. This idea of
"starting easy" and adaptively increasing the difficulty of the learning
problem has its roots in curriculum learning and allows one to train better
models. Indeed, we prove that our optimization strategy implements a very
general curriculum scheme, by gradually adding noise to both the input and
intermediate feature representations within the network architecture.
Experiments on seven image classification datasets and different network
architectures show that our method, named Curriculum Dropout, frequently yields
to better generalization and, at worst, performs just as well as the standard
Dropout method.

10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
27
The categories of this paper are: comp-gas
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom