Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: GPU-Accelerated Viterbi Exact Lattice Decoder for Batched Online and
  Offline Speech Recognition   We present an optimized weighted finite-state transducer (WFST) decoder
capable of online streaming and offline batch processing of audio using
Graphics Processing Units (GPUs). The decoder is efficient in memory
utilization, input/output (I/O) bandwidth, and uses a novel Viterbi
implementation designed to maximize parallelism. The reduced memory footprint
allows the decoder to process significantly larger graphs than previously
possible, while optimizing I/O increases the number of simultaneous streams
supported. GPU preprocessing of lattice segments enables intermediate lattice
results to be returned to the requestor during streaming inference.
Collectively, the proposed algorithm yields up to a 240x speedup over single
core CPU decoding, and up to 40x faster decoding than the current
state-of-the-art GPU decoder, while returning equivalent results. This decoder
design enables deployment of production-grade ASR models on a large spectrum of
systems, ranging from large data center servers to low-power edge devices.

30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
16
The categories of this paper are: stat
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex