Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Earnings-22: A Practical Benchmark for Accents in the Wild   Modern automatic speech recognition (ASR) systems have achieved superhuman
Word Error Rate (WER) on many common corpora despite lacking adequate
performance on speech in the wild. Beyond that, there is a lack of real-world,
accented corpora to properly benchmark academic and commercial models. To
ensure this type of speech is represented in ASR benchmarking, we present
Earnings-22, a 125 file, 119 hour corpus of English-language earnings calls
gathered from global companies. We run a comparison across 4 commercial models
showing the variation in performance when taking country of origin into
consideration. Looking at hypothesis transcriptions, we explore errors common
to all ASR systems tested. By examining Individual Word Error Rate (IWER), we
find that key speech features impact model performance more for certain accents
than others. Earnings-22 provides a free-to-use benchmark of real-world,
accented audio to bridge academic and industrial research.

36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
22
The categories of this paper are: chao-dyn
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
16
The categories of this paper are: stat
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an