baseten
/

Meta-Llama-3.1-Instruct-tokenizer

Text Generation

Model card Files Files and versions Community

Meta-Llama-3.1-Instruct-tokenizer

1 contributor

History: 2 commits

strangervb's picture

cloning 3.1 tokenizer to avoid extra dependency

938b9ff verified 3 months ago

.gitattributes

1.52 kB

initial commit 3 months ago
LICENSE

7.63 kB

cloning 3.1 tokenizer to avoid extra dependency 3 months ago
README.md

44 kB

cloning 3.1 tokenizer to avoid extra dependency 3 months ago
USE_POLICY.md

4.69 kB

cloning 3.1 tokenizer to avoid extra dependency 3 months ago
generation_config.json

184 Bytes

cloning 3.1 tokenizer to avoid extra dependency 3 months ago
special_tokens_map.json

296 Bytes

cloning 3.1 tokenizer to avoid extra dependency 3 months ago
tokenizer.json

9.09 MB

cloning 3.1 tokenizer to avoid extra dependency 3 months ago
tokenizer_config.json

55.4 kB

cloning 3.1 tokenizer to avoid extra dependency 3 months ago