Wrong Evaluation Report on ColBERTv2

#11
by RobinAkan1 - opened

I ran the "eval-reranker" repo code to generate the BEIR benchmarks .

The results for ColBERTv2 column is mixed up with BM25.

For example :
"NDCG@10 0.5947" is for BM25 and ColBERTv2 is above 70 ish.

RobinAkan1 changed discussion title from Wrong Evaluation Report on ColBERT to Wrong Evaluation Report on ColBERTv2

Sign up or log in to comment