Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improved Text Language Identification for the South African Languages   Virtual assistants and text chatbots have recently been gaining popularity.
Given the short message nature of text-based chat interactions, the language
identification systems of these bots might only have 15 or 20 characters to
make a prediction. However, accurate text language identification is important,
especially in the early stages of many multilingual natural language processing
pipelines.
  This paper investigates the use of a naive Bayes classifier, to accurately
predict the language family that a piece of text belongs to, combined with a
lexicon based classifier to distinguish the specific South African language
that the text is written in. This approach leads to a 31% reduction in the
language detection error.
  In the spirit of reproducible research the training and testing datasets as
well as the code are published on github. Hopefully it will be useful to create
a text language identification shared task for South African languages.

28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
2
The categories of this paper are: math