Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Detecting and correcting the loss of independence in nonlinear conjugate
  gradient   It is well known that search directions in nonlinear conjugate gradient (CG)
can sometimes become nearly dependent, causing a dramatic slow-down in the
convergence rate. We provide a theoretical analysis of this loss of
independence. The analysis applies to the case of a strictly convex objective
function and is motivated by older work of Nemirovsky and Yudin. Loss of
independence can affect several of the well-known variants of nonlinear CG
including Fletcher-Reeves, Polak-Ribi\`ere (nonnegative variant), and
Hager-Zhang.
  Based on our analysis, we propose a relatively inexpensive computational test
for detecting loss of independence. We also propose a method for correcting it
when it is detected, which we call "subspace optimization." Although the
correction method is somewhat expensive, our experiments show that in some
cases, usually the most ill-conditioned ones, it yields a method much faster
than any of these three variants. Even though our theory covers only strongly
convex objective functions, we provide computational results to indicate that
the detection and correction mechanisms may also hold promise for nonconvex
optimization.

29
The categories of this paper are: funct-an
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
1
The categories of this paper are: cs
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
9
The categories of this paper are: nlin