Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards an Enhanced Understanding of Bias in Pre-trained Neural Language
  Models: A Survey with Special Emphasis on Affective Bias   The remarkable progress in Natural Language Processing (NLP) brought about by
deep learning, particularly with the recent advent of large pre-trained neural
language models, is brought into scrutiny as several studies began to discuss
and report potential biases in NLP applications. Bias in NLP is found to
originate from latent historical biases encoded by humans into textual data
which gets perpetuated or even amplified by NLP algorithm. We present a survey
to comprehend bias in large pre-trained language models, analyze the stages at
which they occur in these models, and various ways in which these biases could
be quantified and mitigated. Considering wide applicability of textual
affective computing based downstream tasks in real-world systems such as
business, healthcare, education, etc., we give a special emphasis on
investigating bias in the context of affect (emotion) i.e., Affective Bias, in
large pre-trained language models. We present a summary of various bias
evaluation corpora that help to aid future research and discuss challenges in
the research on bias in pre-trained language models. We believe that our
attempt to draw a comprehensive view of bias in pre-trained language models,
and especially the exploration of affective bias will be highly beneficial to
researchers interested in this evolving field.

14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
2
The categories of this paper are: math
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th
6
The categories of this paper are: astro-ph
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an