Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
IsmaelMousa
/
arabic-bpe-tokenizer
like
1
Summarization
Arabic
doi:10.57967/hf/3065
tokenizers
arabic
BPE
arxiv:
1910.13461
License:
mit
Model card
Files
Files and versions
xet
Community
main
arabic-bpe-tokenizer
3.59 MB
1 contributor
History:
10 commits
IsmaelMousa
Update README.md
d926cf1
verified
about 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 year ago
README.md
Safe
3.39 kB
Update README.md
about 1 year ago
tokenizer.json
Safe
3.59 MB
Upload tokenizer.json with huggingface_hub
about 1 year ago
