Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: BUT-FIT at SemEval-2020 Task 4: Multilingual commonsense   This paper describes work of the BUT-FIT's team at SemEval 2020 Task 4 -
Commonsense Validation and Explanation. We participated in all three subtasks.
In subtasks A and B, our submissions are based on pretrained language
representation models (namely ALBERT) and data augmentation. We experimented
with solving the task for another language, Czech, by means of multilingual
models and machine translated dataset, or translated model inputs. We show that
with a strong machine translation system, our system can be used in another
language with a small accuracy loss. In subtask C, our submission, which is
based on pretrained sequence-to-sequence model (BART), ranked 1st in BLEU score
ranking, however, we show that the correlation between BLEU and human
evaluation, in which our submission ended up 4th, is low. We analyse the
metrics used in the evaluation and we propose an additional score based on
model from subtask B, which correlates well with our manual ranking, as well as
reranking method based on the same principle. We performed an error and dataset
analysis for all subtasks and we present our findings.

7
The categories of this paper are: hep-th
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex