Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans
  Detection   This paper presents our submission to SemEval-2021 Task 5: Toxic Spans
Detection. The purpose of this task is to detect the spans that make a text
toxic, which is a complex labour for several reasons. Firstly, because of the
intrinsic subjectivity of toxicity, and secondly, due to toxicity not always
coming from single words like insults or offends, but sometimes from whole
expressions formed by words that may not be toxic individually. Following this
idea of focusing on both single words and multi-word expressions, we study the
impact of using a multi-depth DistilBERT model, which uses embeddings from
different layers to estimate the final per-token toxicity. Our quantitative
results show that using information from multiple depths boosts the performance
of the model. Finally, we also analyze our best model qualitatively.

12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph
3
The categories of this paper are: physics
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
2
The categories of this paper are: math
18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph