Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Curvature Injected Adaptive Momentum Optimizer for Convolutional Neural
  Networks   In this paper, we propose a new approach, hereafter referred as AdaInject,
for the gradient descent optimizers by injecting the curvature information with
adaptive momentum. Specifically, the curvature information is used as a weight
to inject the second order moment in the update rule. The curvature information
is captured through the short-term parameter history. The AdaInject approach
boosts the parameter update by exploiting the curvature information. The
proposed approach is generic in nature and can be integrated with any existing
adaptive momentum stochastic gradient descent optimizers. The effectiveness of
the AdaInject optimizer is tested using a theoretical analysis as well as
through toy examples. We also show the convergence property of the proposed
injection based optimizer. Further, we depict the efficacy of the AdaInject
approach through extensive experiments in conjunction with the state-of-the-art
optimizers, i.e., AdamInject, diffGradInject, RadamInject, and AdaBeliefInject
on four benchmark datasets. Different CNN models are used in the experiments. A
highest improvement in the top-1 classification error rate of $16.54\%$ is
observed using diffGradInject optimizer with ResNeXt29 model over the CIFAR10
dataset. Overall, we observe very promising performance improvement of existing
optimizers with the proposed AdaInject approach.

24
The categories of this paper are: dg-ga
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
15
The categories of this paper are: nucl-ex