Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Rethinking Performance Estimation in Neural Architecture Search   Neural architecture search (NAS) remains a challenging problem, which is
attributed to the indispensable and time-consuming component of performance
estimation (PE). In this paper, we provide a novel yet systematic rethinking of
PE in a resource constrained regime, termed budgeted PE (BPE), which precisely
and effectively estimates the performance of an architecture sampled from an
architecture space. Since searching an optimal BPE is extremely time-consuming
as it requires to train a large number of networks for evaluation, we propose a
Minimum Importance Pruning (MIP) approach. Given a dataset and a BPE search
space, MIP estimates the importance of hyper-parameters using random forest and
subsequently prunes the minimum one from the next iteration. In this way, MIP
effectively prunes less important hyper-parameters to allocate more
computational resource on more important ones, thus achieving an effective
exploration. By combining BPE with various search algorithms including
reinforcement learning, evolution algorithm, random search, and differentiable
architecture search, we achieve 1, 000x of NAS speed up with a negligible
performance drop comparing to the SOTA

15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
13
The categories of this paper are: quant-ph