Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Which Encoding is the Best for Text Classification in Chinese, English,
  Japanese and Korean?   This article offers an empirical study on the different ways of encoding
Chinese, Japanese, Korean (CJK) and English languages for text classification.
Different encoding levels are studied, including UTF-8 bytes, characters,
words, romanized characters and romanized words. For all encoding levels,
whenever applicable, we provide comparisons with linear models, fastText and
convolutional networks. For convolutional networks, we compare between encoding
mechanisms using character glyph images, one-hot (or one-of-n) encoding, and
embedding. In total there are 473 models, using 14 large-scale text
classification datasets in 4 languages including Chinese, English, Japanese and
Korean. Some conclusions from these results include that byte-level one-hot
encoding based on UTF-8 consistently produces competitive results for
convolutional networks, that word-level n-grams linear models are competitive
even without perfect word segmentation, and that fastText provides the best
result using character-level n-gram encoding but can overfit when the features
are overly rich.

35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin