Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Backyard AI
Draw Things
DiffusionBee
Jellybox
RecurseChat
Msty
Sanctum
Invoke
JoyFusion
LocalAI
vLLM
node-llama-cpp
Ollama
TGI
MLX LM
Docker Model Runner
Inference Providers
Select all
Cerebras
Novita
Nebius AI
Featherless AI
Fireworks
Together AI
Groq
Hyperbolic
Cohere
fal
Nscale
SambaNova
Replicate
HF Inference API
Misc
Reset Misc
NeelNanda/pile-10k
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
119
Full-text search
Edit filters
Sort: Trending
Active filters:
NeelNanda/pile-10k
Clear all
Intel/Kimi-K2-Instruct-gguf-q2ks-mixed-AutoRound
1T
•
Updated
5 days ago
•
106
•
5
Intel/Kimi-K2-Instruct-int4-AutoRound
Updated
4 days ago
•
3
•
5
Intel/Qwen3-235B-A22B-Instruct-2507-int4-AutoRound
1B
•
Updated
5 days ago
•
86
•
2
OPEA/gemma-3-27b-it-int4-AutoRound
5B
•
Updated
10 days ago
•
250
•
3
Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound
2B
•
Updated
3 days ago
•
11.5k
•
4
Intel/Qwen3-8B-gguf-q4km-AutoRound-inc-v1
8B
•
Updated
Jun 20
•
30
•
1
Intel/Qwen3-8B-gguf-q2ks-AutoRound-inc-v2
8B
•
Updated
about 1 month ago
•
49
•
1
Intel/Kimi-K2-Instruct-w8afp8-AutoRound
Updated
4 days ago
•
3
•
1
Intel/Kimi-K2-Instruct-int4-mixed-AutoRound
Updated
4 days ago
•
3
•
1
Intel/Qwen3-235B-A22B-Instruct-2507-int4-asym-AutoRound
1B
•
Updated
4 days ago
•
24
•
1
Intel/Mistral-7B-v0.1-int4-inc
Text Generation
•
1B
•
Updated
May 31, 2024
•
39
•
4
Intel/phi-2-int4-inc
Text Generation
•
0.6B
•
Updated
Oct 22, 2024
•
5
•
3
Intel/gemma-2b-int4-inc
Text Generation
•
1B
•
Updated
Aug 26, 2024
•
5
•
1
Intel/falcon-7b-sq-int8-inc
Text Generation
•
Updated
Apr 17, 2024
•
1
Intel/Phi-3-mini-4k-instruct-int4-inc
Updated
Jul 4, 2024
•
4
Intel/Baichuan2-13B-Chat-int4-inc
Updated
Jul 4, 2024
•
1
Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc
Updated
Jul 4, 2024
•
1
Intel/opt-1.3b-int4-inc-recipe
Updated
Nov 6, 2024
•
1
Intel/Phi-3-mini-128k-instruct-int4-inc-recipe
Updated
Nov 8, 2024
•
1
Intel/Mistral-7B-v0.1-int4-inc-lmhead
Text Generation
•
1B
•
Updated
May 29, 2024
•
11
•
1
Fizzarolli/phi3-4x4b-v1
Text Generation
•
11B
•
Updated
Jun 4, 2024
•
3
•
1
bartowski/phi3-4x4b-v1-GGUF
Text Generation
•
11B
•
Updated
Jun 3, 2024
•
97
Intel/Qwen2-0.5B-Instuct-int4-inc
Text Generation
•
0.3B
•
Updated
Jun 6, 2024
•
4
Intel/Qwen2-1.5B-Instuct-int4-inc
Text Generation
•
0.7B
•
Updated
Jun 6, 2024
•
4
•
2
Intel/Qwen2-7B-int4-inc
Text Generation
•
2B
•
Updated
Oct 24, 2024
•
4
•
6
Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc-v0.3
Updated
Jun 28, 2024
•
2
Intel/Meta-Llama-3.1-8B-Instruct-int4-inc
Updated
Nov 28, 2024
•
2
Intel/Qwen2-57B-A14B-Instruct-int4-inc
9B
•
Updated
Oct 24, 2024
•
2
•
1
Intel/Qwen2.5-0.5B-Instruct-int4-inc
Updated
Oct 10, 2024
•
1
Intel/Qwen2.5-1.5B-Instruct-int4-inc
Updated
Oct 10, 2024
•
1
Previous
1
2
3
4
Next