  We consider the general problem of minimizing an objective function which is
the sum of a convex function (not strictly convex) and absolute values of a
subset of variables (or equivalently the l1-norm of the variables). This
problem appears exten- sively in modern statistical applications associated
with high-dimensional data or "big data", and corresponds to optimizing
l1-regularized likelihoods in the context of model selection. In such
applications, cyclic coordinatewise minimization (CCM), where the objective
function is sequentially minimized with respect to each individual coordi-
nate, is often employed as it offers a computationally cheap and effective
optimization method. Consequently, it is crucial to obtain theoretical
guarantees of convergence for the sequence of iterates produced by the cyclic
coordinatewise minimization in this setting. Moreover, as the objective
corresponds to at l1-regularized likelihoods of many variables, it is important
to obtain convergence of the iterates themselves, and not just the function
values. Previous results in the literature only establish either, (i) that
every limit point of the sequence of iterates is a stationary point of the
objective function, or (ii) establish convergence under special assumptions, or
(iii) establish con- vergence for a different minimization approach (which uses
quadratic approximation based gradient descent followed by an inexact line
search), (iv) establish convergence of only the function values of the sequence
of iterates produced by random coordinatewise minimization (a variant of CCM).
In this paper, a rigorous general proof of convergence for the cyclic
coordinatewise minimization algorithm is provided. We demonstrate the
usefulness of our general results in contemporary applications.
