Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Volumization as a Natural Generalization of Weight Decay   We propose a novel regularization method, called \textit{volumization}, for
neural networks. Inspired by physics, we define a physical volume for the
weight parameters in neural networks, and we show that this method is an
effective way of regularizing neural networks. Intuitively, this method
interpolates between an $L_2$ and $L_\infty$ regularization. Therefore, weight
decay and weight clipping become special cases of the proposed algorithm. We
prove, on a toy example, that the essence of this method is a regularization
technique to control bias-variance tradeoff. The method is shown to do well in
the categories where the standard weight decay method is shown to work well,
including improving the generalization of networks and preventing memorization.
Moreover, we show that the volumization might lead to a simple method for
training a neural network whose weight is binary or ternary.

26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc
2
The categories of this paper are: math
3
The categories of this paper are: physics
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
15
The categories of this paper are: nucl-ex
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph