Hugging Face's logo

yangbang18
/
zeronlg-4langs-mt

sentence-transformers
PyTorch
distilbert
Model card Files
xet
Community
1
yangbang commited on
Commit
64e21a6
·
1 Parent(s): e4a2037

update evaluation results measured by SacreBLEU

Browse files
Files changed (19) hide show
  1. evaluations_translate/de-fr/log.txt +8 -8
  2. evaluations_translate/de-fr/test_scores_de-fr.json +1 -1
  3. evaluations_translate/de-fr/test_scores_fr-de.json +1 -1
  4. evaluations_translate/en-de/log.txt +8 -8
  5. evaluations_translate/en-de/test_scores_de-en.json +1 -1
  6. evaluations_translate/en-de/test_scores_en-de.json +1 -1
  7. evaluations_translate/en-fr/log.txt +8 -8
  8. evaluations_translate/en-fr/test_scores_en-fr.json +1 -1
  9. evaluations_translate/en-fr/test_scores_fr-en.json +1 -1
  10. evaluations_translate/en-zh/log.txt +8 -8
  11. evaluations_translate/en-zh/test_scores_en-zh.json +1 -1
  12. evaluations_translate/en-zh/test_scores_zh-en.json +1 -1
  13. evaluations_translate/en-zh/test_translations_en-zh.json +0 -0
  14. evaluations_translate/zh-de/log.txt +8 -8
  15. evaluations_translate/zh-de/test_scores_de-zh.json +1 -1
  16. evaluations_translate/zh-de/test_scores_zh-de.json +1 -1
  17. evaluations_translate/zh-fr/log.txt +8 -8
  18. evaluations_translate/zh-fr/test_scores_fr-zh.json +1 -1
  19. evaluations_translate/zh-fr/test_scores_zh-fr.json +1 -1
evaluations_translate/de-fr/log.txt CHANGED
@@ -1,13 +1,13 @@
1
- output path: zeronlg-4langs-mt/evaluations_translate/de-fr
2
- Creating model from zeronlg-4langs-mt
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (de) from data/annotations/flickr30k/de-fr/test.de
5
  Loading target sentences (fr) from data/annotations/flickr30k/de-fr/test.fr
6
- Save translation results to zeronlg-4langs-mt/evaluations_translate/de-fr/test_translations_de-fr.json
7
- Save scores to zeronlg-4langs-mt/evaluations_translate/de-fr/test_scores_de-fr.json
8
- [test] [de -> fr] BLEU 0.2087432375773136
9
  Loading source sentences (fr) from data/annotations/flickr30k/de-fr/test.fr
10
  Loading target sentences (de) from data/annotations/flickr30k/de-fr/test.de
11
- Save translation results to zeronlg-4langs-mt/evaluations_translate/de-fr/test_translations_fr-de.json
12
- Save scores to zeronlg-4langs-mt/evaluations_translate/de-fr/test_scores_fr-de.json
13
- [test] [fr -> de] BLEU 0.19578172265168622
 
1
+ output path: output/zeronlg-4langs-mt/evaluations_translate/de-fr
2
+ Creating model from output/zeronlg-4langs-mt/
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (de) from data/annotations/flickr30k/de-fr/test.de
5
  Loading target sentences (fr) from data/annotations/flickr30k/de-fr/test.fr
6
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_translations_de-fr.json
7
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_scores_de-fr.json
8
+ [test] [de -> fr] BLEU 16.665641493787597
9
  Loading source sentences (fr) from data/annotations/flickr30k/de-fr/test.fr
10
  Loading target sentences (de) from data/annotations/flickr30k/de-fr/test.de
11
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_translations_fr-de.json
12
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/de-fr/test_scores_fr-de.json
13
+ [test] [fr -> de] BLEU 18.47518634776254
evaluations_translate/de-fr/test_scores_de-fr.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.2087432375773136}
 
1
+ {"BLEU": 16.665641493787597}
evaluations_translate/de-fr/test_scores_fr-de.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.19578172265168622}
 
1
+ {"BLEU": 18.47518634776254}
evaluations_translate/en-de/log.txt CHANGED
@@ -1,13 +1,13 @@
1
- output path: zeronlg-4langs-mt/evaluations_translate/en-de
2
- Creating model from zeronlg-4langs-mt
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (en) from data/annotations/flickr30k/en-de/test.en
5
  Loading target sentences (de) from data/annotations/flickr30k/en-de/test.de
6
- Save translation results to zeronlg-4langs-mt/evaluations_translate/en-de/test_translations_en-de.json
7
- Save scores to zeronlg-4langs-mt/evaluations_translate/en-de/test_scores_en-de.json
8
- [test] [en -> de] BLEU 0.21614251190520878
9
  Loading source sentences (de) from data/annotations/flickr30k/en-de/test.de
10
  Loading target sentences (en) from data/annotations/flickr30k/en-de/test.en
11
- Save translation results to zeronlg-4langs-mt/evaluations_translate/en-de/test_translations_de-en.json
12
- Save scores to zeronlg-4langs-mt/evaluations_translate/en-de/test_scores_de-en.json
13
- [test] [de -> en] BLEU 0.2322062090156212
 
1
+ output path: output/zeronlg-4langs-mt/evaluations_translate/en-de
2
+ Creating model from output/zeronlg-4langs-mt/
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (en) from data/annotations/flickr30k/en-de/test.en
5
  Loading target sentences (de) from data/annotations/flickr30k/en-de/test.de
6
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-de/test_translations_en-de.json
7
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-de/test_scores_en-de.json
8
+ [test] [en -> de] BLEU 20.453264735067307
9
  Loading source sentences (de) from data/annotations/flickr30k/en-de/test.de
10
  Loading target sentences (en) from data/annotations/flickr30k/en-de/test.en
11
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-de/test_translations_de-en.json
12
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-de/test_scores_de-en.json
13
+ [test] [de -> en] BLEU 21.077586587182278
evaluations_translate/en-de/test_scores_de-en.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.2322062090156212}
 
1
+ {"BLEU": 21.077586587182278}
evaluations_translate/en-de/test_scores_en-de.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.21614251190520878}
 
1
+ {"BLEU": 20.453264735067307}
evaluations_translate/en-fr/log.txt CHANGED
@@ -1,13 +1,13 @@
1
- output path: zeronlg-4langs-mt/evaluations_translate/en-fr
2
- Creating model from zeronlg-4langs-mt
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (en) from data/annotations/flickr30k/en-fr/test.en
5
  Loading target sentences (fr) from data/annotations/flickr30k/en-fr/test.fr
6
- Save translation results to zeronlg-4langs-mt/evaluations_translate/en-fr/test_translations_en-fr.json
7
- Save scores to zeronlg-4langs-mt/evaluations_translate/en-fr/test_scores_en-fr.json
8
- [test] [en -> fr] BLEU 0.2718663726914329
9
  Loading source sentences (fr) from data/annotations/flickr30k/en-fr/test.fr
10
  Loading target sentences (en) from data/annotations/flickr30k/en-fr/test.en
11
- Save translation results to zeronlg-4langs-mt/evaluations_translate/en-fr/test_translations_fr-en.json
12
- Save scores to zeronlg-4langs-mt/evaluations_translate/en-fr/test_scores_fr-en.json
13
- [test] [fr -> en] BLEU 0.26837140457814546
 
1
+ output path: output/zeronlg-4langs-mt/evaluations_translate/en-fr
2
+ Creating model from output/zeronlg-4langs-mt/
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (en) from data/annotations/flickr30k/en-fr/test.en
5
  Loading target sentences (fr) from data/annotations/flickr30k/en-fr/test.fr
6
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_translations_en-fr.json
7
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_scores_en-fr.json
8
+ [test] [en -> fr] BLEU 22.030413156317323
9
  Loading source sentences (fr) from data/annotations/flickr30k/en-fr/test.fr
10
  Loading target sentences (en) from data/annotations/flickr30k/en-fr/test.en
11
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_translations_fr-en.json
12
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-fr/test_scores_fr-en.json
13
+ [test] [fr -> en] BLEU 24.59212796600962
evaluations_translate/en-fr/test_scores_en-fr.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.2718663726914329}
 
1
+ {"BLEU": 22.030413156317323}
evaluations_translate/en-fr/test_scores_fr-en.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.26837140457814546}
 
1
+ {"BLEU": 24.59212796600962}
evaluations_translate/en-zh/log.txt CHANGED
@@ -1,13 +1,13 @@
1
- output path: zeronlg-4langs-mt/evaluations_translate/en-zh
2
- Creating model from zeronlg-4langs-mt
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (en) from data/annotations/flickr30k/en-zh/test.en
5
  Loading target sentences (zh) from data/annotations/flickr30k/en-zh/test.zh
6
- Save translation results to zeronlg-4langs-mt/evaluations_translate/en-zh/test_translations_en-zh.json
7
- Save scores to zeronlg-4langs-mt/evaluations_translate/en-zh/test_scores_en-zh.json
8
- [test] [en -> zh] BLEU 0.06007274022541595
9
  Loading source sentences (zh) from data/annotations/flickr30k/en-zh/test.zh
10
  Loading target sentences (en) from data/annotations/flickr30k/en-zh/test.en
11
- Save translation results to zeronlg-4langs-mt/evaluations_translate/en-zh/test_translations_zh-en.json
12
- Save scores to zeronlg-4langs-mt/evaluations_translate/en-zh/test_scores_zh-en.json
13
- [test] [zh -> en] BLEU 0.09195632674902596
 
1
+ output path: output/zeronlg-4langs-mt/evaluations_translate/en-zh
2
+ Creating model from output/zeronlg-4langs-mt/
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (en) from data/annotations/flickr30k/en-zh/test.en
5
  Loading target sentences (zh) from data/annotations/flickr30k/en-zh/test.zh
6
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-zh/test_translations_en-zh.json
7
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-zh/test_scores_en-zh.json
8
+ [test] [en -> zh] BLEU 14.653849371854607
9
  Loading source sentences (zh) from data/annotations/flickr30k/en-zh/test.zh
10
  Loading target sentences (en) from data/annotations/flickr30k/en-zh/test.en
11
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/en-zh/test_translations_zh-en.json
12
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/en-zh/test_scores_zh-en.json
13
+ [test] [zh -> en] BLEU 8.792425602942425
evaluations_translate/en-zh/test_scores_en-zh.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.06007274022541595}
 
1
+ {"BLEU": 14.653849371854607}
evaluations_translate/en-zh/test_scores_zh-en.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.09195632674902596}
 
1
+ {"BLEU": 8.792425602942425}
evaluations_translate/en-zh/test_translations_en-zh.json CHANGED
The diff for this file is too large to render. See raw diff
 
evaluations_translate/zh-de/log.txt CHANGED
@@ -1,13 +1,13 @@
1
- output path: zeronlg-4langs-mt/evaluations_translate/zh-de
2
- Creating model from zeronlg-4langs-mt
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (zh) from data/annotations/flickr30k/zh-de/test.zh
5
  Loading target sentences (de) from data/annotations/flickr30k/zh-de/test.de
6
- Save translation results to zeronlg-4langs-mt/evaluations_translate/zh-de/test_translations_zh-de.json
7
- Save scores to zeronlg-4langs-mt/evaluations_translate/zh-de/test_scores_zh-de.json
8
- [test] [zh -> de] BLEU 0.07763856049392265
9
  Loading source sentences (de) from data/annotations/flickr30k/zh-de/test.de
10
  Loading target sentences (zh) from data/annotations/flickr30k/zh-de/test.zh
11
- Save translation results to zeronlg-4langs-mt/evaluations_translate/zh-de/test_translations_de-zh.json
12
- Save scores to zeronlg-4langs-mt/evaluations_translate/zh-de/test_scores_de-zh.json
13
- [test] [de -> zh] BLEU 0.04587614840020834
 
1
+ output path: output/zeronlg-4langs-mt/evaluations_translate/zh-de
2
+ Creating model from output/zeronlg-4langs-mt/
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (zh) from data/annotations/flickr30k/zh-de/test.zh
5
  Loading target sentences (de) from data/annotations/flickr30k/zh-de/test.de
6
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/zh-de/test_translations_zh-de.json
7
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/zh-de/test_scores_zh-de.json
8
+ [test] [zh -> de] BLEU 7.327852751917611
9
  Loading source sentences (de) from data/annotations/flickr30k/zh-de/test.de
10
  Loading target sentences (zh) from data/annotations/flickr30k/zh-de/test.zh
11
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/zh-de/test_translations_de-zh.json
12
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/zh-de/test_scores_de-zh.json
13
+ [test] [de -> zh] BLEU 11.850337118963916
evaluations_translate/zh-de/test_scores_de-zh.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.04587614840020834}
 
1
+ {"BLEU": 11.850337118963916}
evaluations_translate/zh-de/test_scores_zh-de.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.07763856049392265}
 
1
+ {"BLEU": 7.327852751917611}
evaluations_translate/zh-fr/log.txt CHANGED
@@ -1,13 +1,13 @@
1
- output path: zeronlg-4langs-mt/evaluations_translate/zh-fr
2
- Creating model from zeronlg-4langs-mt
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (zh) from data/annotations/flickr30k/zh-fr/test.zh
5
  Loading target sentences (fr) from data/annotations/flickr30k/zh-fr/test.fr
6
- Save translation results to zeronlg-4langs-mt/evaluations_translate/zh-fr/test_translations_zh-fr.json
7
- Save scores to zeronlg-4langs-mt/evaluations_translate/zh-fr/test_scores_zh-fr.json
8
- [test] [zh -> fr] BLEU 0.0611131446464097
9
  Loading source sentences (fr) from data/annotations/flickr30k/zh-fr/test.fr
10
  Loading target sentences (zh) from data/annotations/flickr30k/zh-fr/test.zh
11
- Save translation results to zeronlg-4langs-mt/evaluations_translate/zh-fr/test_translations_fr-zh.json
12
- Save scores to zeronlg-4langs-mt/evaluations_translate/zh-fr/test_scores_fr-zh.json
13
- [test] [fr -> zh] BLEU 0.09701580398726979
 
1
+ output path: output/zeronlg-4langs-mt/evaluations_translate/zh-fr
2
+ Creating model from output/zeronlg-4langs-mt/
3
  Evaluation settings: {'num_beams': 3, 'max_length': 128, 'min_length': 5, 'repetition_penalty': 1.0}
4
  Loading source sentences (zh) from data/annotations/flickr30k/zh-fr/test.zh
5
  Loading target sentences (fr) from data/annotations/flickr30k/zh-fr/test.fr
6
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/zh-fr/test_translations_zh-fr.json
7
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/zh-fr/test_scores_zh-fr.json
8
+ [test] [zh -> fr] BLEU 5.165307323190847
9
  Loading source sentences (fr) from data/annotations/flickr30k/zh-fr/test.fr
10
  Loading target sentences (zh) from data/annotations/flickr30k/zh-fr/test.zh
11
+ Save translation results to output/zeronlg-4langs-mt/evaluations_translate/zh-fr/test_translations_fr-zh.json
12
+ Save scores to output/zeronlg-4langs-mt/evaluations_translate/zh-fr/test_scores_fr-zh.json
13
+ [test] [fr -> zh] BLEU 16.222265756873945
evaluations_translate/zh-fr/test_scores_fr-zh.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.09701580398726979}
 
1
+ {"BLEU": 16.222265756873945}
evaluations_translate/zh-fr/test_scores_zh-fr.json CHANGED
@@ -1 +1 @@
1
- {"BLEU": 0.0611131446464097}
 
1
+ {"BLEU": 5.165307323190847}