Qwen
/

Qwen3-0.6B-GPTQ-Int8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

feihu.hf commited on May 8

Commit

7de56fd

·

1 Parent(s): f37dd6e

update README

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -273,8 +273,8 @@ print(responses)
 | --- | --- | --- | --- | --- |
 | Thinking | bf16 | 30.3 | 27.9 | 55.6 |
 | Thinking | GPTQ-int8 | 30.2 | 29.3 | 53.8 |
-| Non-Thinking | bf16 | 21.8 | 22.9 | 44.9 |
-| Non-Thinking | GPTQ-int8 | 21.8 | 23.2 | 44.6 |
 ## Best Practices

 | --- | --- | --- | --- | --- |
 | Thinking | bf16 | 30.3 | 27.9 | 55.6 |
 | Thinking | GPTQ-int8 | 30.2 | 29.3 | 53.8 |
+| Non-Thinking | bf16 | 21.8 | 22.9 | 44.6 |
+| Non-Thinking | GPTQ-int8 | 21.8 | 23.2 | 44.9 |
 ## Best Practices