Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Stochastic Second-order Methods for Non-convex Optimization with Inexact
  Hessian and Gradient   Trust region and cubic regularization methods have demonstrated good
performance in small scale non-convex optimization, showing the ability to
escape from saddle points. Each iteration of these methods involves computation
of gradient, Hessian and function value in order to obtain the search direction
and adjust the radius or cubic regularization parameter. However, exactly
computing those quantities are too expensive in large-scale problems such as
training deep networks. In this paper, we study a family of stochastic trust
region and cubic regularization methods when gradient, Hessian and function
values are computed inexactly, and show the iteration complexity to achieve
$\epsilon$-approximate second-order optimality is in the same order with
previous work for which gradient and function values are computed exactly. The
mild conditions on inexactness can be achieved in finite-sum minimization using
random sampling. We show the algorithm performs well on training convolutional
neural networks compared with previous second-order methods.

24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph