| base_model: TinyLlama/TinyLlama_v1.1 | |
| language: en | |
| license: mit | |
| ## Metrics | |
| |PPL | arc_easy |arc_challenge| piqa | winogrande | hellaswag |mmlu|QA Avg| | |
| |---:|------------|-------------|------------|------------|------------|----|-----:| | |
| |5.99|74.66 ± 0.89|39.76 ± 1.43 |76.88 ± 0.98|67.88 ± 1.31|55.16 ± 0.50|- | 62.87| | |
| Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631) | |
| - **License:** mit | |
| - **Finetuned from:** TinyLlama/TinyLlama_v1.1 |