Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: An evaluation of word-level confidence estimation for end-to-end
  automatic speech recognition   Quantifying the confidence (or conversely the uncertainty) of a prediction is
a highly desirable trait of an automatic system, as it improves the robustness
and usefulness in downstream tasks. In this paper we investigate confidence
estimation for end-to-end automatic speech recognition (ASR). Previous work has
addressed confidence measures for lattice-based ASR, while current machine
learning research mostly focuses on confidence measures for unstructured deep
learning. However, as the ASR systems are increasingly being built upon deep
end-to-end methods, there is little work that tries to develop confidence
measures in this context. We fill this gap by providing an extensive benchmark
of popular confidence methods on four well-known speech datasets. There are two
challenges we overcome in adapting existing methods: working on structured data
(sequences) and obtaining confidences at a coarser level than the predictions
(words instead of tokens). Our results suggest that a strong baseline can be
obtained by scaling the logits by a learnt temperature, followed by estimating
the confidence as the negative entropy of the predictive distribution and,
finally, sum pooling to aggregate at word level.

9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph
24
The categories of this paper are: dg-ga
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
2
The categories of this paper are: math