Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
baseten
/
Meta-Llama-3.1-Instruct-tokenizer
like
0
Text Generation
PyTorch
8 languages
facebook
meta
llama
llama-3
conversational
arxiv:
2204.05149
License:
llama3.1
Model card
Files
Files and versions
Community
main
Meta-Llama-3.1-Instruct-tokenizer
1 contributor
History:
2 commits
strangervb
cloning 3.1 tokenizer to avoid extra dependency
938b9ff
verified
about 1 month ago
.gitattributes
1.52 kB
initial commit
about 1 month ago
LICENSE
7.63 kB
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago
README.md
44 kB
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago
USE_POLICY.md
4.69 kB
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago
generation_config.json
184 Bytes
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago
special_tokens_map.json
296 Bytes
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago
tokenizer.json
9.09 MB
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago
tokenizer_config.json
55.4 kB
cloning 3.1 tokenizer to avoid extra dependency
about 1 month ago