Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Space-efficient detection of unusual words   Detecting all the strings that occur in a text more frequently or less
frequently than expected according to an IID or a Markov model is a basic
problem in string mining, yet current algorithms are based on data structures
that are either space-inefficient or incur large slowdowns, and current
implementations cannot scale to genomes or metagenomes in practice. In this
paper we engineer an algorithm based on the suffix tree of a string to use just
a small data structure built on the Burrows-Wheeler transform, and a stack of
$O(\sigma^2\log^2 n)$ bits, where $n$ is the length of the string and $\sigma$
is the size of the alphabet. The size of the stack is $o(n)$ except for very
large values of $\sigma$. We further improve the algorithm by removing its time
dependency on $\sigma$, by reporting only a subset of the maximal repeats and
of the minimal rare words of the string, and by detecting and scoring candidate
under-represented strings that $\textit{do not occur}$ in the string. Our
algorithms are practical and work directly on the BWT, thus they can be
immediately applied to a number of existing datasets that are available in this
form, returning this string mining problem to a manageable scale.

37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
2
The categories of this paper are: math
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
10
The categories of this paper are: q-bio
27
The categories of this paper are: comp-gas
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th