Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units   The acoustic-to-word model based on the Connectionist Temporal Classification
(CTC) criterion is a natural end-to-end (E2E) system directly targeting word as
output unit. Two issues exist in the system: first, the current output of the
CTC model relies on the current input and does not account for context weighted
inputs. This is the hard alignment issue. Second, the word-based CTC model
suffers from the out-of-vocabulary (OOV) issue. This means it can model only
frequently occurring words while tagging the remaining words as OOV. Hence,
such a model is limited in its capacity in recognizing only a fixed set of
frequent words. In this study, we propose addressing these problems using a
combination of attention mechanism and mixed-units. In particular, we introduce
Attention CTC, Self-Attention CTC, Hybrid CTC, and Mixed-unit CTC.
  First, we blend attention modeling capabilities directly into the CTC network
using Attention CTC and Self-Attention CTC. Second, to alleviate the OOV issue,
we present Hybrid CTC which uses a word and letter CTC with shared hidden
layers. The Hybrid CTC consults the letter CTC when the word CTC emits an OOV.
Then, we propose a much better solution by training a Mixed-unit CTC which
decomposes all the OOV words into sequences of frequent words and multi-letter
units. Evaluated on a 3400 hours Microsoft Cortana voice assistant task, our
final acoustic-to-word solution using attention and mixed-units achieves a
relative reduction in word error rate (WER) over the vanilla word CTC by
12.09\%. Such an E2E model without using any language model (LM) or complex
decoder also outperforms a traditional context-dependent (CD) phoneme CTC with
strong LM and decoder by 6.79% relative.

7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math