Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Expressivity of Neural Networks via Chaotic Itineraries beyond
  Sharkovsky's Theorem   Given a target function $f$, how large must a neural network be in order to
approximate $f$? Recent works examine this basic question on neural network
\textit{expressivity} from the lens of dynamical systems and provide novel
``depth-vs-width'' tradeoffs for a large family of functions $f$. They suggest
that such tradeoffs are governed by the existence of \textit{periodic} points
or \emph{cycles} in $f$. Our work, by further deploying dynamical systems
concepts, illuminates a more subtle connection between periodicity and
expressivity: we prove that periodic points alone lead to suboptimal
depth-width tradeoffs and we improve upon them by demonstrating that certain
``chaotic itineraries'' give stronger exponential tradeoffs, even in regimes
where previous analyses only imply polynomial gaps. Contrary to prior works,
our bounds are nearly-optimal, tighten as the period increases, and handle
strong notions of inapproximability (e.g., constant $L_1$ error). More broadly,
we identify a phase transition to the \textit{chaotic regime} that exactly
coincides with an abrupt shift in other notions of function complexity,
including VC-dimension and topological entropy.

22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int