Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,800

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-14m-int8-step143000-GPTQ-wikitext2

Text Generation • 0.0B • Updated Jul 17, 2024 • 4

tedindie/semikong-8b-awq

Text Generation • 2B • Updated Jul 18, 2024 • 3

infly/INF-34B-Chat-GPTQ-4bit

Text Generation • 6B • Updated Jul 25, 2024 • 3 • 2

infly/INF-34B-Chat-GPTQ-8bit

Text Generation • 10B • Updated Jul 25, 2024 • 3

Nkumah7/gemma-1.1-2b-it-4bit-gptq

Text Generation • 0.8B • Updated Jul 18, 2024 • 4

Xu-Ouyang/pythia-1.4b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 18, 2024 • 3

Xu-Ouyang/pythia-1.4b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 18, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 18, 2024 • 3

Xu-Ouyang/pythia-410m-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-1.4b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-6.9b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 5

Xu-Ouyang/pythia-410m-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-1.4b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 6

Xu-Ouyang/pythia-410m-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-1.4b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-1.4b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-6.9b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 3

ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit

Text Generation • 3B • Updated Jul 23, 2024 • 23 • 4

Xu-Ouyang/pythia-410m-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 5

Xu-Ouyang/pythia-70m-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Aug 9, 2024 • 3

Xu-Ouyang/pythia-70m-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Aug 9, 2024 • 3