Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Investigating the Effects of Word Substitution Errors on Sentence
  Embeddings   A key initial step in several natural language processing (NLP) tasks
involves embedding phrases of text to vectors of real numbers that preserve
semantic meaning. To that end, several methods have been recently proposed with
impressive results on semantic similarity tasks. However, all of these
approaches assume that perfect transcripts are available when generating the
embeddings. While this is a reasonable assumption for analysis of written text,
it is limiting for analysis of transcribed text. In this paper we investigate
the effects of word substitution errors, such as those coming from automatic
speech recognition errors (ASR), on several state-of-the-art sentence embedding
methods. To do this, we propose a new simulator that allows the experimenter to
induce ASR-plausible word substitution errors in a corpus at a desired word
error rate. We use this simulator to evaluate the robustness of several
sentence embedding methods. Our results show that pre-trained neural sentence
encoders are both robust to ASR errors and perform well on textual similarity
tasks after errors are introduced. Meanwhile, unweighted averages of word
vectors perform well with perfect transcriptions, but their performance
degrades rapidly on textual similarity tasks for text with word substitution
errors.

16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
23
The categories of this paper are: solv-int