Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Optimal Transport Kernels for Sequential and Parallel Neural
  Architecture Search   Neural architecture search (NAS) automates the design of deep neural
networks. One of the main challenges in searching complex and non-continuous
architectures is to compare the similarity of networks that the conventional
Euclidean metric may fail to capture. Optimal transport (OT) is resilient to
such complex structure by considering the minimal cost for transporting a
network into another. However, the OT is generally not negative definite which
may limit its ability to build the positive-definite kernels required in many
kernel-dependent frameworks. Building upon tree-Wasserstein (TW), which is a
negative definite variant of OT, we develop a novel discrepancy for neural
architectures, and demonstrate it within a Gaussian process surrogate model for
the sequential NAS settings. Furthermore, we derive a novel parallel NAS, using
quality k-determinantal point process on the GP posterior, to select diverse
and high-performing architectures from a discrete set of candidates.
Empirically, we demonstrate that our TW-based approaches outperform other
baselines in both sequential and parallel NAS.

12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
5
The categories of this paper are: gr-qc
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
22
The categories of this paper are: chao-dyn