Cyrile Delestre
commited on
Commit
·
22e7078
1
Parent(s):
6bffc61
Update README.md
Browse files
README.md
CHANGED
|
@@ -39,12 +39,16 @@ Evaluation results
|
|
| 39 |
Benchmark
|
| 40 |
---------
|
| 41 |
|
|
|
|
|
|
|
| 42 |
| **NLI** | **time (ms)** | **MCC (x100)** |
|
| 43 |
| :--------------: | :-----------: | :------------: |
|
| 44 |
| [cmarkea/distilcamembert-base-nli](https://huggingface.co/cmarkea/distilcamembert-base-nli) | **51.35** | **66.24** |
|
| 45 |
| [BaptisteDoyen/camembert-base-xnli](https://huggingface.co/BaptisteDoyen/camembert-base-xnli) | 105.0 | 72.67 |
|
| 46 |
| [MoritzLaurer/mDeBERTa-v3-base-mnli-xnli](https://huggingface.co/MoritzLaurer/mDeBERTa-v3-base-mnli-xnli) | 299.18 | 75.15 |
|
| 47 |
|
|
|
|
|
|
|
| 48 |
| **Allociné** | **time (ms)** | **MCC (x100)** |
|
| 49 |
| :--------------: | :-----------: | :------------: |
|
| 50 |
| [cmarkea/distilcamembert-base-nli](https://huggingface.co/cmarkea/distilcamembert-base-nli) | **205.54** | **63.71** |
|
|
|
|
| 39 |
Benchmark
|
| 40 |
---------
|
| 41 |
|
| 42 |
+
We compare the [DistilCamemBERT](https://huggingface.co/cmarkea/distilcamembert-base) model with 2 others modelization works on French language. The first [BaptisteDoyen/camembert-base-xnli](https://huggingface.co/BaptisteDoyen/camembert-base-xnli) is based on well named [CamemBERT](https://huggingface.co/camembert-base), the frech RnoBETa model and a ththz rd [MoritzLaurer/mDeBERTa-v3-base-mnli-xnli](https://huggingface.co/MoritzLaurer/mDeBERTa-v3-base-mnli-xnli) based on [mDeBERTav3](https://huggingface.co/microsoft/mdeberta-v3-base) a multilingue model.
|
| 43 |
+
|
| 44 |
| **NLI** | **time (ms)** | **MCC (x100)** |
|
| 45 |
| :--------------: | :-----------: | :------------: |
|
| 46 |
| [cmarkea/distilcamembert-base-nli](https://huggingface.co/cmarkea/distilcamembert-base-nli) | **51.35** | **66.24** |
|
| 47 |
| [BaptisteDoyen/camembert-base-xnli](https://huggingface.co/BaptisteDoyen/camembert-base-xnli) | 105.0 | 72.67 |
|
| 48 |
| [MoritzLaurer/mDeBERTa-v3-base-mnli-xnli](https://huggingface.co/MoritzLaurer/mDeBERTa-v3-base-mnli-xnli) | 299.18 | 75.15 |
|
| 49 |
|
| 50 |
+
$$P(hypothesis=c|premise)=\frac{e^{P(premise=entailment\vert hypothesis\; c)}}{\sum_{i\in\mathcal{C}}e^{P(premise=entailment\vert hypothesis\; i)}}$$
|
| 51 |
+
|
| 52 |
| **Allociné** | **time (ms)** | **MCC (x100)** |
|
| 53 |
| :--------------: | :-----------: | :------------: |
|
| 54 |
| [cmarkea/distilcamembert-base-nli](https://huggingface.co/cmarkea/distilcamembert-base-nli) | **205.54** | **63.71** |
|