Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,017

Full-text search

Active filters: gptq

infly/INF-34B-Chat-GPTQ-4bit

Text Generation • 6B • Updated Jul 25, 2024 • 59 • 2

infly/INF-34B-Chat-GPTQ-8bit

Text Generation • 10B • Updated Jul 25, 2024 • 62

Nkumah7/gemma-1.1-2b-it-4bit-gptq

Text Generation • 0.8B • Updated Jul 18, 2024

Xu-Ouyang/pythia-1.4b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 18, 2024

Xu-Ouyang/pythia-1.4b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 18, 2024

Xu-Ouyang/pythia-410m-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 18, 2024

Xu-Ouyang/pythia-410m-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024

Xu-Ouyang/pythia-1.4b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024

Xu-Ouyang/pythia-6.9b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024

Xu-Ouyang/pythia-410m-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024

Xu-Ouyang/pythia-410m-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 1

Xu-Ouyang/pythia-1.4b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024

Xu-Ouyang/pythia-410m-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 1

Xu-Ouyang/pythia-410m-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 1

Xu-Ouyang/pythia-1.4b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024

Xu-Ouyang/pythia-410m-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 1

Xu-Ouyang/pythia-1.4b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024

Xu-Ouyang/pythia-6.9b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024

ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit

Text Generation • 3B • Updated Jul 23, 2024 • 28 • 5

Xu-Ouyang/pythia-410m-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 19, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 19, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 19, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 19, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 19, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 19, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Aug 9, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Aug 9, 2024

Xu-Ouyang/pythia-1.4b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024

Xu-Ouyang/pythia-1.4b-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024