Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Algorithms and SQ Lower Bounds for PAC Learning One-Hidden-Layer ReLU
  Networks   We study the problem of PAC learning one-hidden-layer ReLU networks with $k$
hidden units on $\mathbb{R}^d$ under Gaussian marginals in the presence of
additive label noise. For the case of positive coefficients, we give the first
polynomial-time algorithm for this learning problem for $k$ up to
$\tilde{O}(\sqrt{\log d})$. Previously, no polynomial time algorithm was known,
even for $k=3$. This answers an open question posed by~\cite{Kliv17}.
Importantly, our algorithm does not require any assumptions about the rank of
the weight matrix and its complexity is independent of its condition number. On
the negative side, for the more general task of PAC learning one-hidden-layer
ReLU networks with arbitrary real coefficients, we prove a Statistical Query
lower bound of $d^{\Omega(k)}$. Thus, we provide a separation between the two
classes in terms of efficient learnability. Our upper and lower bounds are
general, extending to broader families of activation functions.

4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
6
The categories of this paper are: astro-ph
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph