Models

jerryzh168/Qwen3-4B-INT8-INT4

Text Generation • Updated 25 days ago • 19

pytorch/gemma-3-12b-it-AWQ-INT4

Image-Text-to-Text • Updated 4 days ago • 637

zlyngkhoi/Llama-3.2-1B-Instruct-torchao-8bit-2

Updated 19 days ago • 29

nue2554/Qwen2.5-14B-Instruct-Int4WeightOnly

Text Generation • Updated 19 days ago • 10

zera09/Meta-Llama-3-8B-Torchao

Text Generation • Updated 18 days ago • 19

jerryzh168/gemma-3-12b-it-INT4

Image-Text-to-Text • Updated 4 days ago • 87

jerryzh168/gemma-3-27b-it-INT4

Image-Text-to-Text • Updated 4 days ago • 167

pytorch/gemma-3-27b-it-AWQ-INT4

Image-Text-to-Text • Updated 4 days ago • 1.42k • 1

zera09/Llama-3.2-1B-Instruct-torchao-8bit

Updated 16 days ago • 58

liangel/Float8WeightOnlyConfig-v2-0.14.0.dev-safetensors

Text Generation • 0.1B • Updated 15 days ago • 20

torchao-testing/opt-125m-ModuleFqnToConfig-v1-regex-0.14.0.dev

Updated 11 days ago • 223

metascroy/gemma-3-4b-it-INT8-INT4-HQQ

Text Generation • Updated 12 days ago • 165

metascroy/gemma-3-4b-it-INT8-INT4

Image-Text-to-Text • Updated 13 days ago • 145

torchao-testing/opt-125m-Int4WeightOnlyConfig-v2-0.14.0.dev

Text Generation • Updated 13 days ago • 39

metascroy/Qwen3-4B-INT8-INT4

Text Generation • Updated 8 days ago • 31

metascroy/Qwen3-4B-INT8-INT4-HQQ

Text Generation • Updated 8 days ago • 26

metascroy/Phi-4-mini-instruct-INT8-INT4-HQQ

Text Generation • Updated 8 days ago • 31

metascroy/Phi-4-mini-instruct-INT8-INT4

Text Generation • Updated 8 days ago • 22

metascroy/SmolLM3-3B-INT8-INT4

Text Generation • Updated 8 days ago • 33

metascroy/SmolLM3-3B-INT8-INT4-HQQ

Text Generation • Updated 8 days ago • 30

metascroy/Llama-3.2-1B-INT8-INT4-HQQ

Text Generation • Updated 8 days ago • 46

metascroy/Llama-3.2-1B-INT8-INT4

Text Generation • Updated 8 days ago • 25

andrewor14/Qwen3-8B-QAT-INT4

Text Generation • Updated 6 days ago • 32

jerryzh168/gemma-3-27b-it-AWQ-INT4

Image-Text-to-Text • Updated 5 days ago • 109

metascroy/Llama-3.2-1B-Instruct-int8-int4

Text Generation • Updated 5 days ago • 41

metascroy/qwen3-2bit-tulu-finetune

Text Generation • Updated 5 days ago • 20

metascroy/qwen3-3bit-tulu-finetune

Text Generation • Updated 5 days ago • 15

metascroy/qwen3-4bit-tulu-finetune

Text Generation • Updated 4 days ago • 22

rahul7star/facebook-125

Updated 1 day ago • 12

lvj/Qwen3-4B-parq-2b-weight-4b-embed-shared-hf

Updated about 8 hours ago • 98