  In this paper, by designing a normalized nonmonotone search strategy with the
Barzilai--Borwein-type step-size, a novel local minimax method (LMM), which is
a globally convergent iterative method, is proposed and analyzed to find
multiple (unstable) saddle points of nonconvex functionals in Hilbert spaces.
Compared to traditional LMMs with monotone search strategies, this approach,
which does not require strict decrease of the objective functional value at
each iterative step, is observed to converge faster with less computations.
Firstly, based on a normalized iterative scheme coupled with a local peak
selection that pulls the iterative point back onto the solution submanifold, by
generalizing the Zhang--Hager (ZH) search strategy in the optimization theory
to the LMM framework, a kind of normalized ZH-type nonmonotone step-size search
strategy is introduced, and then a novel nonmonotone LMM is constructed. Its
feasibility and global convergence results are rigorously carried out under the
relaxation of the monotonicity for the functional at the iterative sequences.
Secondly, in order to speed up the convergence of the nonmonotone LMM, a
globally convergent Barzilai--Borwein-type LMM (GBBLMM) is presented by
explicitly constructing the Barzilai--Borwein-type step-size as a trial
step-size of the normalized ZH-type nonmonotone step-size search strategy in
each iteration. Finally, the GBBLMM algorithm is implemented to find multiple
unstable solutions of two classes of semilinear elliptic boundary value
problems with variational structures: one is the semilinear elliptic equations
with the homogeneous Dirichlet boundary condition and another is the linear
elliptic equations with semilinear Neumann boundary conditions. Extensive
numerical results indicate that our approach is very effective and speeds up
the LMMs significantly.
