Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

447

Full-text search

Active filters: pruna-ai

PrunaAI/WizardLM-WizardCoder-3B-V1.0-bnb-8bit-smashed

Text Generation • 3B • Updated Aug 2, 2024 • 1.69k

PrunaAI/cerebras-Cerebras-GPT-590M-bnb-4bit-smashed

Text Generation • 0.3B • Updated Aug 2, 2024 • 7

PrunaAI/vinai-PhoGPT-4B-Chat-bnb-8bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 21

PrunaAI/deepseek-ai-deepseek-math-7b-base-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 7

PrunaAI/codegemma-2b-bnb-4bit-smashed

Text Generation • 2B • Updated Aug 2, 2024 • 6 • 1

PrunaAI/gpt2-large-bnb-8bit-smashed

Text Generation • 0.8B • Updated Aug 2, 2024 • 9

PrunaAI/phi-2-GGUF-smashed

3B • Updated Aug 2, 2024 • 900

PrunaAI/Mistral-22B-v0.2-GGUF-smashed

22B • Updated Aug 2, 2024 • 206 • 3

PrunaAI/Mistral-7B-Instruct-v0.2-GGUF-smashed

7B • Updated Aug 2, 2024 • 128 • 1

PrunaAI/zephyr-orpo-141b-A35b-v0.1-GGUF-smashed

141B • Updated Aug 2, 2024 • 1.13k • 4

PrunaAI/Poro-34B-GGUF-smashed

35B • Updated Aug 2, 2024 • 86

PrunaAI/lynn-7b-alpha-GGUF-smashed

7B • Updated Aug 2, 2024 • 359

PrunaAI/codegemma-7b-it-GGUF-smashed

9B • Updated Aug 2, 2024 • 404 • 2

PrunaAI/WizardLM-2-7B-GGUF-smashed

7B • Updated Aug 2, 2024 • 477 • 3

PrunaAI/gemma-2b-it-GGUF-smashed

3B • Updated Aug 2, 2024 • 304 • 2

PrunaAI/gemma-2b-GGUF-smashed

3B • Updated Aug 2, 2024 • 287 • 2

PrunaAI/Meta-Llama-3-70B-Instruct-GGUF-smashed

71B • Updated Aug 2, 2024 • 92 • 7

PrunaAI/Meta-Llama-3-8B-Instruct-GGUF-smashed

8B • Updated Aug 2, 2024 • 323 • 5

PrunaAI/gemma-1.1-2b-it-GGUF-smashed

3B • Updated Aug 2, 2024 • 1.31k • 2

PrunaAI/codegemma-2b-GGUF-smashed

3B • Updated Aug 2, 2024 • 550 • 4

PrunaAI/Meta-Llama-3-70b-instruct-AWQ-smashed

Text Generation • 11B • Updated Aug 2, 2024 • 31 • 9

PrunaAI/codegemma-7b-GGUF-smashed

9B • Updated Aug 2, 2024 • 647 • 1

PrunaAI/Llama-3-13B-Instruct-v0.1-GGUF-smashed

13B • Updated Aug 2, 2024 • 422

PrunaAI/stablelm-2-12b-GGUF-smashed

12B • Updated Aug 2, 2024 • 198 • 1

PrunaAI/Llama-3-16B-GGUF-smashed

17B • Updated Aug 2, 2024 • 131 • 1

PrunaAI/CodeQwen1.5-7B-Chat-GGUF-smashed

7B • Updated Aug 2, 2024 • 249 • 2

PrunaAI/Meta-Llama-Guard-2-8B-GGUF-smashed

8B • Updated Aug 2, 2024 • 412 • 2

PrunaAI/Llama3-8B-Chinese-Chat-GGUF-smashed

8B • Updated Aug 2, 2024 • 573 • 30

PrunaAI/dolphin-2.9-llama3-8b-GGUF-smashed

8B • Updated Aug 2, 2024 • 910 • 3

PrunaAI/Llama-3-8B-16K-GGUF-smashed

8B • Updated Aug 2, 2024 • 466 • 2