Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Designing Network Design Spaces   In this work, we present a new network design paradigm. Our goal is to help
advance the understanding of network design and discover design principles that
generalize across settings. Instead of focusing on designing individual network
instances, we design network design spaces that parametrize populations of
networks. The overall process is analogous to classic manual design of
networks, but elevated to the design space level. Using our methodology we
explore the structure aspect of network design and arrive at a low-dimensional
design space consisting of simple, regular networks that we call RegNet. The
core insight of the RegNet parametrization is surprisingly simple: widths and
depths of good networks can be explained by a quantized linear function. We
analyze the RegNet design space and arrive at interesting findings that do not
match the current practice of network design. The RegNet design space provides
simple and fast networks that work well across a wide range of flop regimes.
Under comparable training settings and flops, the RegNet models outperform the
popular EfficientNet models while being up to 5x faster on GPUs.

12
The categories of this paper are: nucl-th
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
9
The categories of this paper are: nlin
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph