Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Scalable Data Annotation Pipeline for High-Quality Large Speech Datasets
  Development   This paper introduces a human-in-the-loop (HITL) data annotation pipeline to
generate high-quality, large-scale speech datasets. The pipeline combines human
and machine advantages to more quickly, accurately, and cost-effectively
annotate datasets with machine pre-labeling and fully manual auditing. Quality
control mechanisms such as blind testing, behavior monitoring, and data
validation have been adopted in the annotation pipeline to mitigate potential
bias introduced by machine-generated labels. Our A/B testing and pilot results
demonstrated the HITL pipeline can improve annotation speed and capacity by at
least 80% and quality is comparable to or higher than manual double pass
annotation. We are leveraging this scalable pipeline to create and continuously
grow ultra-high volume off-the-shelf (UHV-OTS) speech corpora for multiple
languages, with the capability to expand to 10,000+ hours per language
annually. Customized datasets can be produced from the UHV-OTS corpora using
dynamic packaging. UHV-OTS is a long-term Appen project to support commercial
and academic research data needs in speech processing. Appen will donate a
number of free speech datasets from the UHV-OTS each year to support academic
and open source community research under the CC-BY-SA license. We are also
releasing the code of the data pre-processing and pre-tagging pipeline under
the Apache 2.0 license to allow reproduction of the results reported in the
paper.

5
The categories of this paper are: gr-qc
26
The categories of this paper are: bayes-an
16
The categories of this paper are: stat
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
14
The categories of this paper are: math-ph
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
4
The categories of this paper are: cond-mat
31
The categories of this paper are: ao-sci