Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
IsmaelMousa
/
arabic-bpe-tokenizer
like
0
Summarization
Arabic
doi:10.57967/hf/3065
tokenizers
arabic
BPE
arxiv:
1910.13461
License:
mit
Model card
Files
Files and versions
Community
main
arabic-bpe-tokenizer
1 contributor
History:
10 commits
IsmaelMousa
Update README.md
d926cf1
verified
2 months ago
.gitattributes
Safe
1.52 kB
initial commit
2 months ago
README.md
Safe
3.39 kB
Update README.md
2 months ago
tokenizer.json
Safe
3.59 MB
Upload tokenizer.json with huggingface_hub
2 months ago