Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Tiny Neural Models for Seq2Seq   Semantic parsing models with applications in task oriented dialog systems
require efficient sequence to sequence (seq2seq) architectures to be run
on-device. To this end, we propose a projection based encoder-decoder model
referred to as pQRNN-MAtt. Studies based on projection methods were restricted
to encoder-only models, and we believe this is the first study extending it to
seq2seq architectures. The resulting quantized models are less than 3.5MB in
size and are well suited for on-device latency critical applications. We show
that on MTOP, a challenging multilingual semantic parsing dataset, the average
model performance surpasses LSTM based seq2seq model that uses pre-trained
embeddings despite being 85x smaller. Furthermore, the model can be an
effective student for distilling large pre-trained models such as T5/BERT.

9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex