Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multi-rater delta: extending the delta nominal measure of agreement
  between two raters to many raters   The need to measure the degree of agreement among R raters who independently
classify n subjects within K nominal categories is frequent in many scientific
areas. The most popular measures are Cohen's kappa (R = 2), Fleiss' kappa,
Conger's kappa and Hubert's kappa (R $\geq$ 2) coefficients, which have several
defects. In 2004, the delta coefficient was defined for the case of R = 2,
which did not have the defects of Cohen's kappa coefficient. This article
extends the coefficient delta from R = 2 raters to R $\geq$ 2. The coefficient
multi-rater delta has the same advantages as the coefficient delta with regard
to the type kappa coefficients: i) it is intuitive and easy to interpret,
because it refers to the proportion of replies that are concordant and non
random; ii) the summands which give its value allow the degree of agreement in
each category to be measured accurately, with no need to be collapsed; and iii)
it is not affected by the marginal imbalance.

15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
21
The categories of this paper are: adap-org
25
The categories of this paper are: patt-sol
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph