metadata
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
Metrics
| PPL | arc_easy | arc_challenge | piqa | winogrande | hellaswag | mmlu | QA Avg |
|---|---|---|---|---|---|---|---|
| 5.99 | 74.66 ± 0.89 | 39.76 ± 1.43 | 76.88 ± 0.98 | 67.88 ± 1.31 | 55.16 ± 0.50 | - | 62.87 |
Training method based on BitDistiller Paper
- License: mit
- Finetuned from: TinyLlama/TinyLlama_v1.1