Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Pretrained language model transfer on neural named entity recognition in
  Indonesian conversational texts   Named entity recognition (NER) is an important task in NLP, which is all the
more challenging in conversational domain with their noisy facets. Moreover,
conversational texts are often available in limited amount, making supervised
tasks infeasible. To learn from small data, strong inductive biases are
required. Previous work relied on hand-crafted features to encode these biases
until transfer learning emerges. Here, we explore a transfer learning method,
namely language model pretraining, on NER task in Indonesian conversational
texts. We utilize large unlabeled data (generic domain) to be transferred to
conversational texts, enabling supervised training on limited in-domain data.
We report two transfer learning variants, namely supervised model fine-tuning
and unsupervised pretrained LM fine-tuning. Our experiments show that both
variants outperform baseline neural models when trained on small data (100
sentences), yielding an absolute improvement of 32 points of test F1 score.
Furthermore, we find that the pretrained LM encodes part-of-speech information
which is a strong predictor for NER.

35
The categories of this paper are: mtrl-th
10
The categories of this paper are: q-bio
20
The categories of this paper are: acc-phys
30
The categories of this paper are: q-alg
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ