Semantic Textual Similarity in Catalan
STS corpus is a benchmark for evaluating Semantic Text Similarity in Catalan.
It consists of more than 3000 sentence pairs, annotated with the semantic similarity between them, using a scale from 0 (no similarity at all) to 5 (semantic equivalence). It is done manually by 4 different annotators following our guidelines based on previous work from the SemEval challenges (https://www.aclweb.org/anthology/S13-1004.pdf).

The source data are scraped sentences from the Catalan Textual Corpus (https://doi.org/10.5281/zenodo.4519349), used under CC-by-SA-4.0 licence (https://creativecommons.org/licenses/by-sa/4.0/). The dataset is released under the same licence.

This dataset was developed by BSC TeMU as part of the AINA project, and to enrich the Catalan Language Understanding Benchmark (CLUB).


https://zenodo.org/record/4761434
Barcelona Supercomputing Center - CNS
A university or research institution
Spain
Carme Armentano
carme.armentano@bsc.es
https://temu.bsc.es/
Yes - it has a direct download link or links
https://zenodo.org/record/4761434
Yes
public domain
cc-by-4.0: Creative Commons Attribution 4.0 International