Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining   Neural Architecture Search (NAS) yields state-of-the-art neural networks that
outperform their best manually-designed counterparts. However, previous NAS
methods search for architectures under one set of training hyper-parameters
(i.e., a training recipe), overlooking superior architecture-recipe
combinations. To address this, we present Neural Architecture-Recipe Search
(NARS) to search both (a) architectures and (b) their corresponding training
recipes, simultaneously. NARS utilizes an accuracy predictor that scores
architecture and training recipes jointly, guiding both sample selection and
ranking. Furthermore, to compensate for the enlarged search space, we leverage
"free" architecture statistics (e.g., FLOP count) to pretrain the predictor,
significantly improving its sample efficiency and prediction reliability. After
training the predictor via constrained iterative optimization, we run fast
evolutionary searches in just CPU minutes to generate architecture-recipe pairs
for a variety of resource constraints, called FBNetV3. FBNetV3 makes up a
family of state-of-the-art compact neural networks that outperform both
automatically and manually-designed competitors. For example, FBNetV3 matches
both EfficientNet and ResNeSt accuracy on ImageNet with up to 2.0x and 7.1x
fewer FLOPs, respectively. Furthermore, FBNetV3 yields significant performance
gains for downstream object detection tasks, improving mAP despite 18% fewer
FLOPs and 34% fewer parameters than EfficientNet-based equivalents.

30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
16
The categories of this paper are: stat
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics