Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: AdvantageNAS: Efficient Neural Architecture Search with Credit
  Assignment   Neural architecture search (NAS) is an approach for automatically designing a
neural network architecture without human effort or expert knowledge. However,
the high computational cost of NAS limits its use in commercial applications.
Two recent NAS paradigms, namely one-shot and sparse propagation, which reduce
the time and space complexities, respectively, provide clues for solving this
problem. In this paper, we propose a novel search strategy for one-shot and
sparse propagation NAS, namely AdvantageNAS, which further reduces the time
complexity of NAS by reducing the number of search iterations. AdvantageNAS is
a gradient-based approach that improves the search efficiency by introducing
credit assignment in gradient estimation for architecture updates. Experiments
on the NAS-Bench-201 and PTB dataset show that AdvantageNAS discovers an
architecture with higher performance under a limited time budget compared to
existing sparse propagation NAS. To further reveal the reliabilities of
AdvantageNAS, we investigate it theoretically and find that it monotonically
improves the expected loss and thus converges.

4
The categories of this paper are: cond-mat
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
27
The categories of this paper are: comp-gas
7
The categories of this paper are: hep-th
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
23
The categories of this paper are: solv-int
36
The categories of this paper are: cmp-lg