Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Semantic Distance: A New Metric for ASR Performance Analysis Towards
  Spoken Language Understanding   Word Error Rate (WER) has been the predominant metric used to evaluate the
performance of automatic speech recognition (ASR) systems. However, WER is
sometimes not a good indicator for downstream Natural Language Understanding
(NLU) tasks, such as intent recognition, slot filling, and semantic parsing in
task-oriented dialog systems. This is because WER takes into consideration only
literal correctness instead of semantic correctness, the latter of which is
typically more important for these downstream tasks. In this study, we propose
a novel Semantic Distance (SemDist) measure as an alternative evaluation metric
for ASR systems to address this issue. We define SemDist as the distance
between a reference and hypothesis pair in a sentence-level embedding space. To
represent the reference and hypothesis as a sentence embedding, we exploit
RoBERTa, a state-of-the-art pre-trained deep contextualized language model
based on the transformer architecture. We demonstrate the effectiveness of our
proposed metric on various downstream tasks, including intent recognition,
semantic parsing, and named entity recognition.

11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph