Wrong Evaluation Report on ColBERTv2
#11
by
RobinAkan1
- opened
I ran the "eval-reranker" repo code to generate the BEIR benchmarks .
The results for ColBERTv2 column is mixed up with BM25.
For example :
"NDCG@10 0.5947" is for BM25 and ColBERTv2 is above 70 ish.
RobinAkan1
changed discussion title from
Wrong Evaluation Report on ColBERT
to Wrong Evaluation Report on ColBERTv2