Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,031

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-2.8b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.9B • Updated Aug 18, 2024

Xu-Ouyang/pythia-12b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 17, 2024

HRuiii/Meta-Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • Updated Jul 11, 2024

Xu-Ouyang/pythia-12b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 18, 2024

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • 2B • Updated Jul 17, 2024 • 24 • 6

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • 3B • Updated Jul 23, 2024 • 3 • 2

Ksgk-fy/eCoach-v1-gptq

Text Generation • 3B • Updated Jul 11, 2024

Xu-Ouyang/pythia-12b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 18, 2024

Ksgk-fy/maria-v2-gptq

Text Generation • 3B • Updated Jul 11, 2024

Xu-Ouyang/pythia-410m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 11, 2024

Xu-Ouyang/pythia-410m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 11, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 11, 2024 • 1

RedHatAI/Qwen2-72B-Instruct-quantized.w4a16

Text Generation • 12B • Updated Jul 18, 2024 • 8 • 4

RedHatAI/Qwen2-7B-Instruct-quantized.w4a16

Text Generation • 2B • Updated Jul 18, 2024 • 4

RedHatAI/Llama-2-7b-chat-quantized.w4a16

Text Generation • 1B • Updated Jul 18, 2024 • 6

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation • 11B • Updated Aug 29, 2024 • 18 • 2

RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation • 2B • Updated Jul 18, 2024 • 19 • 2

Xu-Ouyang/pythia-410m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 11, 2024

RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation • 1B • Updated Mar 13 • 396 • 2

Xu-Ouyang/pythia-6.9b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • 0.9B • Updated Jul 11, 2024

Xu-Ouyang/pythia-410m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 11, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-6.9b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • 0.9B • Updated Jul 11, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-6.9b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • 0.9B • Updated Jul 12, 2024

Xu-Ouyang/pythia-6.9b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • 0.9B • Updated Jul 12, 2024

Xu-Ouyang/pythia-6.9b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • 0.9B • Updated Jul 12, 2024 • 1