Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fast and Accurate Model Scaling   In this work we analyze strategies for convolutional neural network scaling;
that is, the process of scaling a base convolutional network to endow it with
greater computational complexity and consequently representational power.
Example scaling strategies may include increasing model width, depth,
resolution, etc. While various scaling strategies exist, their tradeoffs are
not fully understood. Existing analysis typically focuses on the interplay of
accuracy and flops (floating point operations). Yet, as we demonstrate, various
scaling strategies affect model parameters, activations, and consequently
actual runtime quite differently. In our experiments we show the surprising
result that numerous scaling strategies yield networks with similar accuracy
but with widely varying properties. This leads us to propose a simple fast
compound scaling strategy that encourages primarily scaling model width, while
scaling depth and resolution to a lesser extent. Unlike currently popular
scaling strategies, which result in about $O(s)$ increase in model activation
w.r.t. scaling flops by a factor of $s$, the proposed fast compound scaling
results in close to $O(\sqrt{s})$ increase in activations, while achieving
excellent accuracy. This leads to comparable speedups on modern memory-limited
hardware (e.g., GPU, TPU). More generally, we hope this work provides a
framework for analyzing and selecting scaling strategies under various
computational constraints.

3
The categories of this paper are: physics
16
The categories of this paper are: stat
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
20
The categories of this paper are: acc-phys
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin