Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Distributed Second-Order Algorithm You Can Trust   Due to the rapid growth of data and computational resources, distributed
optimization has become an active research area in recent years. While
first-order methods seem to dominate the field, second-order methods are
nevertheless attractive as they potentially require fewer communication rounds
to converge. However, there are significant drawbacks that impede their wide
adoption, such as the computation and the communication of a large Hessian
matrix. In this paper we present a new algorithm for distributed training of
generalized linear models that only requires the computation of diagonal blocks
of the Hessian matrix on the individual workers. To deal with this approximate
information we propose an adaptive approach that - akin to trust-region methods
- dynamically adapts the auxiliary model to compensate for modeling errors. We
provide theoretical rates of convergence for a wide class of problems including
L1-regularized objectives. We also demonstrate that our approach achieves
state-of-the-art results on multiple large benchmark datasets.

23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
20
The categories of this paper are: acc-phys
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci