Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,059

Full-text search

Active filters: gptq

Lawnel/Meta-llama-3-8B-GPTQ

Text Generation • 2B • Updated Jul 13, 2024

parasail-ai/aya-23-8B-GPTQ-4bit

Text Generation • 2B • Updated Jul 15, 2024 • 2

gdsaikrishna/Qwen1_7B_base_gptq_int3_g64_wikitext2

Text Generation • 2B • Updated Jul 15, 2024 • 1

gdsaikrishna/Qwen1_7B_base_gptq_int3_g32_wikitext2

Text Generation • 2B • Updated Jul 15, 2024

luis5tb/prometheus-eval-8x7b-gptq-marlin

Text Generation • 6B • Updated Jul 15, 2024

HRuiii/Llama-2-7b-GPTQ-8bit

Text Generation • Updated Jul 15, 2024

HRuiii/Llama-2-7b-GPTQ-4bit

Text Generation • Updated Jul 15, 2024

Ksgk-fy/maria_v113_gptq_prompt

Text Generation • 3B • Updated Jul 15, 2024

Xu-Ouyang/Qwen-7B-int3-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 15, 2024

Xu-Ouyang/Qwen-7B-int4-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 15, 2024

luis5tb/prometheus-eval-8x7b-gptq-marlin-vmwareds

Text Generation • 6B • Updated Jul 16, 2024

alouafi/Meta-llama-3-8B-GPTQ

Text Generation • Updated Jul 16, 2024

arturoguizar/Llama-2-7b-hf-GPTQ

Text Generation • Updated Jul 16, 2024

alouafi/Meta-llama-3-8B-Instruct-GPTQ

Text Generation • Updated Jul 16, 2024

shuyuej/Command-R-GPTQ

Text Generation • 9B • Updated Jul 25, 2024 • 1 • 1

kushagrrrr/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Jul 16, 2024

thesven/gemma-2-9b-it-GPTQ

Text Generation • 2B • Updated Jul 16, 2024 • 4

Toby0830/internlm2_5-7b-chat-1m-gptq-8bits

Feature Extraction • 3B • Updated Jul 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • 52.9M • Updated Jul 16, 2024

Xu-Ouyang/pythia-70m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • 52.9M • Updated Jul 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • 52.9M • Updated Jul 16, 2024

Xu-Ouyang/pythia-70m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • 52.9M • Updated Jul 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • 52.9M • Updated Jul 16, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int3-step71000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int3-step110000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int3-step143000-GPTQ-wikitext2

Text Generation • 53.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 16, 2024

Xu-Ouyang/pythia-70m-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • 54.1M • Updated Jul 16, 2024