File size: 492 Bytes
ebf7042 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---
## Metrics
|PPL | arc_easy |arc_challenge| piqa | winogrande | hellaswag |mmlu|QA Avg|
|---:|------------|-------------|------------|------------|------------|----|-----:|
|5.99|74.66 ± 0.89|39.76 ± 1.43 |76.88 ± 0.98|67.88 ± 1.31|55.16 ± 0.50|- | 62.87|
Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)
- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1 |