Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep Relaxation: partial differential equations for optimizing deep
  neural networks   In this paper we establish a connection between non-convex optimization
methods for training deep neural networks and nonlinear partial differential
equations (PDEs). Relaxation techniques arising in statistical physics which
have already been used successfully in this context are reinterpreted as
solutions of a viscous Hamilton-Jacobi PDE. Using a stochastic control
interpretation allows we prove that the modified algorithm performs better in
expectation that stochastic gradient descent. Well-known PDE regularity results
allow us to analyze the geometry of the relaxed energy landscape, confirming
empirical evidence. The PDE is derived from a stochastic homogenization
problem, which arises in the implementation of the algorithm. The algorithms
scale well in practice and can effectively tackle the high dimensionality of
modern neural networks.

37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
9
The categories of this paper are: nlin
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
14
The categories of this paper are: math-ph