Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fortunately, Discourse Markers Can Enhance Language Models for Sentiment
  Analysis   In recent years, pretrained language models have revolutionized the NLP
world, while achieving state of the art performance in various downstream
tasks. However, in many cases, these models do not perform well when labeled
data is scarce and the model is expected to perform in the zero or few shot
setting. Recently, several works have shown that continual pretraining or
performing a second phase of pretraining (inter-training) which is better
aligned with the downstream task, can lead to improved results, especially in
the scarce data setting. Here, we propose to leverage sentiment-carrying
discourse markers to generate large-scale weakly-labeled data, which in turn
can be used to adapt language models for sentiment analysis. Extensive
experimental results show the value of our approach on various benchmark
datasets, including the finance domain. Code, models and data are available at
https://github.com/ibm/tslm-discourse-markers.

8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat