Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Model Tree
Base
Adapters
Finetunes
Quantizations
Merges
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
JoyFusion
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Unsloth Studio
Pi
Hermes Agent
Inference Providers
Select all
Groq
Novita
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
DeepInfra
WaveSpeed
Misc
Reset Misc
tokenizer
Inference Endpoints
text-generation-inference
Eval Results (legacy)
text-embeddings-inference
4-bit precision
custom_code
Merge
8-bit precision
Mixture of Experts
Carbon Emissions
Eval Results
Apply filters
Models
1,279
Base only
Inference Available
Inference
Edit filters
Sort: Trending
Active filters:
tokenizer
Clear all
Saxo/llama3_Linkbricks_korean_tokenzier_stem1
Updated
Dec 5, 2024
BEE-spoke-data/claude-tokenizer-forT5
Updated
Dec 29, 2025
riotu-lab/Aranizer-PBE-32k
Updated
Aug 25, 2024
•
1
novateur/WavTokenizer
Text-to-Speech
•
Updated
Dec 2, 2024
•
56
ibm-research/DAC.speech.v1.0
Updated
Sep 19, 2024
•
18
•
16
pszemraj/sail-slimpajama-6B-32768-BPE-tokenizer
Updated
Dec 29, 2025
gpwr/bark-it-tokenizer
Updated
Nov 9, 2024
charanhu/kannada-tokenizer
Text Generation
•
Updated
Nov 12, 2024
•
2
GlowCheese/minBERT
Text Classification
•
Updated
Dec 4, 2024
•
1
AhmetSemih/tr_tokenizer
Updated
Dec 26, 2024
aliarda/turkish_tokenizer
Updated
Dec 3, 2024
•
1
aliarda/turkish_tokenizer_256k
Updated
Dec 4, 2024
•
1
tejagowda/t5-hebrew-translation
Text Classification
•
0.2B
•
Updated
Dec 7, 2024
•
5
aloobun/IN-Llama-3-Tokenizer
Updated
Mar 7, 2025
Saiteja/telugu-bpe
Updated
Jan 5, 2025
•
5
aayushraina/hindi-bpe-tokenizer
Text Generation
•
Updated
Jan 11, 2025
aayushraina/bpe-hindi
Text Generation
•
Updated
Jan 11, 2025
physical-intelligence/fast
Robotics
•
Updated
Jan 16, 2025
•
172
InterwebAlchemy/PGNTokenizer
Updated
Feb 11, 2025
•
1
sachin6624/sachin-gpt2-tokenizer
Updated
Feb 3, 2025
•
1
nilsleh/eo-vae
Image-to-Image
•
Updated
Feb 15
•
1
Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity
Updated
Feb 18, 2025
Ornaments/72k-TK-BBPE-HF
Updated
Feb 18, 2025
savath/laonlp-enhanced
Updated
Feb 21, 2025
mishmish66/throwing_fast
Robotics
•
Updated
Feb 28, 2025
•
1
Adiii143/code-search-net-tokenizer
Updated
Mar 12, 2025
TuKoResearch/WavCochV8192
Feature Extraction
•
11.1M
•
Updated
Jan 12
•
53
mishmish66/trying-fast
Robotics
•
Updated
Apr 22, 2025
•
1
deshanksuman/romanized-sinhala-tokenizer
Updated
Sep 14, 2025
Namuun123/mn_sentencepiece_tokenizer
Updated
Apr 25, 2025
Previous
1
2
3
4
...
43
Next