Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Evaluating the Effectiveness of Efficient Neural Architecture Search for
  Sentence-Pair Tasks   Neural Architecture Search (NAS) methods, which automatically learn entire
neural model or individual neural cell architectures, have recently achieved
competitive or state-of-the-art (SOTA) performance on variety of natural
language processing and computer vision tasks, including language modeling,
natural language inference, and image classification. In this work, we explore
the applicability of a SOTA NAS algorithm, Efficient Neural Architecture Search
(ENAS) (Pham et al., 2018) to two sentence pair tasks, paraphrase detection and
semantic textual similarity. We use ENAS to perform a micro-level search and
learn a task-optimized RNN cell architecture as a drop-in replacement for an
LSTM. We explore the effectiveness of ENAS through experiments on three
datasets (MRPC, SICK, STS-B), with two different models (ESIM, BiLSTM-Max), and
two sets of embeddings (Glove, BERT). In contrast to prior work applying ENAS
to NLP tasks, our results are mixed -- we find that ENAS architectures
sometimes, but not always, outperform LSTMs and perform similarly to random
architecture search.

13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
12
The categories of this paper are: nucl-th
33
The categories of this paper are: plasm-ph
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat