Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,772

Full-text search

Active filters: gptq

ModelCloud/DeepSeek-V2-Chat-0628-gptq-4bit

Text Generation • Updated Jul 20, 2024 • 7 • 3

Xu-Ouyang/pythia-6.9b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 2

navubolecou/semikong-8b-GGUF

Text Generation • 2B • Updated Jul 19, 2024 • 8

acl-srw-2024/llama-3-8b-instruct-cs-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 2

acl-srw-2024/llama-3-8b-instruct-scb-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 3

acl-srw-2024/llama-3-8b-instruct-scb-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 3

acl-srw-2024/llama-3-8b-instruct-cs-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 2

Xu-Ouyang/pythia-2.8b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 2

Xu-Ouyang/pythia-2.8b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 2

acl-srw-2024/llama-3-8b-instruct-scb-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-2.8b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 2

acl-srw-2024/llama-3-8b-instruct-cs-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-6.9b-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 2

Xu-Ouyang/pythia-2.8b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 2

shuyuej/Command-R-Plus-GPTQ

Text Generation • 17B • Updated Jul 25, 2024 • 4 • 1

Xu-Ouyang/pythia-410m-deduped-int3-step14000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int3-step29000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 2

acl-srw-2024/llama-3-8b-instruct-scb-gptq-8bit

Text Generation • Updated Jul 20, 2024 • 3

Xu-Ouyang/pythia-410m-deduped-int3-step43000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 2

acl-srw-2024/llama-3-8b-instruct-cs-gptq-8bit

Text Generation • Updated Jul 20, 2024 • 4

Xu-Ouyang/pythia-2.8b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int3-step57000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int3-step86000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int3-step100000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int3-step115000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-2.8b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-410m-deduped-int3-step129000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int3-step14000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Aug 16, 2024 • 4

Xu-Ouyang/pythia-70m-deduped-int3-step29000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int3-step43000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Aug 16, 2024 • 2