Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: How rotational invariance of common kernels prevents generalization in
  high dimensions   Kernel ridge regression is well-known to achieve minimax optimal rates in
low-dimensional settings. However, its behavior in high dimensions is much less
understood. Recent work establishes consistency for kernel regression under
certain assumptions on the ground truth function and the distribution of the
input data. In this paper, we show that the rotational invariance property of
commonly studied kernels (such as RBF, inner product kernels and
fully-connected NTK of any depth) induces a bias towards low-degree polynomials
in high dimensions. Our result implies a lower bound on the generalization
error for a wide range of distributions and various choices of the scaling for
kernels with different eigenvalue decays. This lower bound suggests that
general consistency results for kernel ridge regression in high dimensions
require a more refined analysis that depends on the structure of the kernel
beyond its eigenvalue decay.

3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol