Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: The cost-free nature of optimally tuning Tikhonov regularizers and other
  ordered smoothers   We consider the problem of selecting the best estimator among a family of
Tikhonov regularized estimators, or, alternatively, to select a linear
combination of these regularizers that is as good as the best regularizer in
the family. Our theory reveals that if the Tikhonov regularizers share the same
penalty matrix with different tuning parameters, a convex procedure based on
$Q$-aggregation achieves the mean square error of the best estimator, up to a
small error term no larger than $C\sigma^2$, where $\sigma^2$ is the noise
level and $C>0$ is an absolute constant. Remarkably, the error term does not
depend on the penalty matrix or the number of estimators as long as they share
the same penalty matrix, i.e., it applies to any grid of tuning parameters, no
matter how large the cardinality of the grid is. This reveals the surprising
"cost-free" nature of optimally tuning Tikhonov regularizers, in striking
contrast with the existing literature on aggregation of estimators where one
typically has to pay a cost of $\sigma^2\log(M)$ where $M$ is the number of
estimators in the family. The result holds, more generally, for any family of
ordered linear smoothers. This encompasses Ridge regression as well as
Principal Component Regression. The result is extended to the problem of tuning
Tikhonov regularizers with different penalty matrices.

34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
13
The categories of this paper are: quant-ph
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
9
The categories of this paper are: nlin
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat