Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Efficiency of Coordinate Descent Methods For Structured Nonconvex
  Optimization   Novel coordinate descent (CD) methods are proposed for minimizing nonconvex
functions consisting of three terms: (i) a continuously differentiable term,
(ii) a simple convex term, and (iii) a concave and continuous term. First, by
extending randomized CD to nonsmooth nonconvex settings, we develop a
coordinate subgradient method that randomly updates block-coordinate variables
by using block composite subgradient mapping. This method converges
asymptotically to critical points with proven sublinear convergence rate for
certain optimality measures. Second, we develop a randomly permuted CD method
with two alternating steps: linearizing the concave part and cycling through
variables. We prove asymptotic convergence to critical points and sublinear
complexity rate for objectives with both smooth and concave parts. Third, we
extend accelerated coordinate descent (ACD) to nonsmooth and nonconvex
optimization to develop a novel randomized proximal DC algorithm whereby we
solve the subproblem inexactly by ACD. Convergence is guaranteed with at most a
few number of ACD iterations for each DC subproblem, and convergence complexity
is established for identification of some approximate critical points. Fourth,
we further develop the third method to minimize certain ill-conditioned
nonconvex functions: weakly convex functions with high Lipschitz constant to
negative curvature ratios. We show that, under specific criteria, the ACD-based
randomized method has superior complexity compared to conventional gradient
methods. Finally, an empirical study on sparsity-inducing learning models
demonstrates that CD methods are superior to gradient-based methods for certain
large-scale problems.

31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol