Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Lessons Learned from Applying off-the-shelf BERT: There is no Silver
  Bullet   One of the challenges in the NLP field is training large classification
models, a task that is both difficult and tedious. It is even harder when GPU
hardware is unavailable. The increased availability of pre-trained and
off-the-shelf word embeddings, models, and modules aim at easing the process of
training large models and achieving a competitive performance. We explore the
use of off-the-shelf BERT models and share the results of our experiments and
compare their results to those of LSTM networks and more simple baselines. We
show that the complexity and computational cost of BERT is not a guarantee for
enhanced predictive performance in the classification tasks at hand.

18
The categories of this paper are: econ
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
33
The categories of this paper are: plasm-ph
31
The categories of this paper are: ao-sci