Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for
  Abstract Word Prediction   This paper describes our system for Task 4 of SemEval-2021: Reading
Comprehension of Abstract Meaning (ReCAM). We participated in all subtasks
where the main goal was to predict an abstract word missing from a statement.
We fine-tuned the pre-trained masked language models namely BERT and ALBERT and
used an Ensemble of these as our submitted system on Subtask 1
(ReCAM-Imperceptibility) and Subtask 2 (ReCAM-Nonspecificity). For Subtask 3
(ReCAM-Intersection), we submitted the ALBERT model as it gives the best
results. We tried multiple approaches and found that Masked Language
Modeling(MLM) based approach works the best.

32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
5
The categories of this paper are: gr-qc
16
The categories of this paper are: stat
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat