Qwen
/

Qwen3-0.6B-GPTQ-Int8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

feihu.hf commited on May 8

Commit

f37dd6e

·

1 Parent(s): d629b3c

update README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -270,7 +270,7 @@ print(responses)
 ## Performance
 | Mode | QUANTIZATION TYPE | LiveBench 2024-11-25 | GPQA | MMLU-Redux |
-| --- | --- | --- | --- | --- | --- |
 | Thinking | bf16 | 30.3 | 27.9 | 55.6 |
 | Thinking | GPTQ-int8 | 30.2 | 29.3 | 53.8 |
 | Non-Thinking | bf16 | 21.8 | 22.9 | 44.9 |

 ## Performance
 | Mode | QUANTIZATION TYPE | LiveBench 2024-11-25 | GPQA | MMLU-Redux |
+| --- | --- | --- | --- | --- |
 | Thinking | bf16 | 30.3 | 27.9 | 55.6 |
 | Thinking | GPTQ-int8 | 30.2 | 29.3 | 53.8 |
 | Non-Thinking | bf16 | 21.8 | 22.9 | 44.9 |