Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Gradient descent follows the regularization path for general losses   Recent work across many machine learning disciplines has highlighted that
standard descent methods, even without explicit regularization, do not merely
minimize the training error, but also exhibit an implicit bias. This bias is
typically towards a certain regularized solution, and relies upon the details
of the learning process, for instance the use of the cross-entropy loss.
  In this work, we show that for empirical risk minimization over linear
predictors with arbitrary convex, strictly decreasing losses, if the risk does
not attain its infimum, then the gradient-descent path and the
algorithm-independent regularization path converge to the same direction
(whenever either converges to a direction). Using this result, we provide a
justification for the widely-used exponentially-tailed losses (such as the
exponential loss or the logistic loss): while this convergence to a direction
for exponentially-tailed losses is necessarily to the maximum-margin direction,
other losses such as polynomially-tailed losses may induce convergence to a
direction with a poor margin.

23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
14
The categories of this paper are: math-ph
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph