Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SpeechBERT: An Audio-and-text Jointly Learned Language Model for
  End-to-end Spoken Question Answering   While various end-to-end models for spoken language understanding tasks have
been explored recently, this paper is probably the first known attempt to
challenge the very difficult task of end-to-end spoken question answering
(SQA). Learning from the very successful BERT model for various text processing
tasks, here we proposed an audio-and-text jointly learned SpeechBERT model.
This model outperformed the conventional approach of cascading ASR with the
following text question answering (TQA) model on datasets including ASR errors
in answer spans, because the end-to-end model was shown to be able to extract
information out of audio data before ASR produced errors. When ensembling the
proposed end-to-end model with the cascade architecture, even better
performance was achieved. In addition to the potential of end-to-end SQA, the
SpeechBERT can also be considered for many other spoken language understanding
tasks just as BERT for many text processing tasks.

30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat