  For many applications involving a sequence of linear systems with slowly
changing system matrices, subspace recycling, which exploits relationships
among systems and reuses search space information, can achieve huge gains in
iterations across the total number of linear system solves in the sequence.
However, for general (i.e., non-identity) shifted systems with the shift value
varying over a wide range, the properties of the linear systems vary widely as
well, which makes recycling less effective. If such a sequence of systems is
embedded in a nonlinear iteration, the problem is compounded, and special
approaches are needed to use recycling effectively.
  In this paper, we develop new, more efficient, Krylov subspace recycling
approaches for large-scale image reconstruction and restoration techniques that
employ a nonlinear iteration to compute a suitable regularization matrix. For
each new regularization matrix, we need to solve regularized linear systems,
${\bf A} + \gamma_\ell {\bf E}_k$, for a sequence of regularization parameters,
$\gamma_\ell$, to find the optimally regularized solution that, in turn, will
be used to update the regularization matrix.
  In this paper, we analyze system and solution characteristics to choose
appropriate techniques to solve each system rapidly. Specifically, we use an
inner-outer recycling approach with a larger, principal recycle space for each
nonlinear step and smaller recycle spaces for each shift. We propose an
efficient way to obtain good initial guesses from the principle recycle space
and smaller shift-specific recycle spaces that lead to fast convergence. Our
method is substantially reduces the total number of matrix-vector products that
would arise in a naive approach. Our approach is more generally applicable to
sequences of shifted systems where the matrices in the sum are positive
semi-definite.
