Update README.md

Quantization updated

README.md

@@ -10,6 +10,21 @@ pipeline_tag: text-generation
 library_name: transformers
 ---
 
+## Exllama v2 Quantizations of OlympicCoder-7B
+
+Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.2.8">turboderp's ExLlamaV2 v0.2.8</a> for quantization.
+
+average:8.0bpw
+lm_head:8.0bpw
+```sh
+python convert.py \
+    -i {path}/OlympicCoder-7B \
+    -o {path}/OlympicCoder-7B/workingdir/ \
+    -cf {path}/OlympicCoder-7B_8.0bpw/ \
+    -b 8.0 \
+    -hb 8
+```
+
 # Model Card for OlympicCoder-7B
 
 OlympicCoder-7B is a code model that achieves strong performance on competitive coding benchmarks such as LiveCodeBench and the 2024 International Olympiad in Informatics.