Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: End-to-End Neural Transformer Based Spoken Language Understanding   Spoken language understanding (SLU) refers to the process of inferring the
semantic information from audio signals. While the neural transformers
consistently deliver the best performance among the state-of-the-art neural
architectures in field of natural language processing (NLP), their merits in a
closely related field, i.e., spoken language understanding (SLU) have not beed
investigated. In this paper, we introduce an end-to-end neural
transformer-based SLU model that can predict the variable-length domain,
intent, and slots vectors embedded in an audio signal with no intermediate
token prediction architecture. This new architecture leverages the
self-attention mechanism by which the audio signal is transformed to various
sub-subspaces allowing to extract the semantic context implied by an utterance.
Our end-to-end transformer SLU predicts the domains, intents and slots in the
Fluent Speech Commands dataset with accuracy equal to 98.1 \%, 99.6 \%, and
99.6 \%, respectively and outperforms the SLU models that leverage a
combination of recurrent and convolutional neural networks by 1.4 \% while the
size of our model is 25\% smaller than that of these architectures.
Additionally, due to independent sub-space projections in the self-attention
layer, the model is highly parallelizable which makes it a good candidate for
on-device SLU.

23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
27
The categories of this paper are: comp-gas
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci