Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Hardware/Software Co-Exploration of Neural Architectures   We propose a novel hardware and software co-exploration framework for
efficient neural architecture search (NAS). Different from existing
hardware-aware NAS which assumes a fixed hardware design and explores the
neural architecture search space only, our framework simultaneously explores
both the architecture search space and the hardware design space to identify
the best neural architecture and hardware pairs that maximize both test
accuracy and hardware efficiency. Such a practice greatly opens up the design
freedom and pushes forward the Pareto frontier between hardware efficiency and
test accuracy for better design tradeoffs. The framework iteratively performs a
two-level (fast and slow) exploration. Without lengthy training, the fast
exploration can effectively fine-tune hyperparameters and prune inferior
architectures in terms of hardware specifications, which significantly
accelerates the NAS process. Then, the slow exploration trains candidates on a
validation set and updates a controller using the reinforcement learning to
maximize the expected accuracy together with the hardware efficiency.
Experiments on ImageNet show that our co-exploration NAS can find the neural
architectures and associated hardware design with the same accuracy, 35.24%
higher throughput, 54.05% higher energy efficiency and 136x reduced search
time, compared with the state-of-the-art hardware-aware NAS.

32
The categories of this paper are: atom-ph
20
The categories of this paper are: acc-phys
26
The categories of this paper are: bayes-an
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
15
The categories of this paper are: nucl-ex
37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
16
The categories of this paper are: stat
14
The categories of this paper are: math-ph