Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

SaulLu
/

codex-like-tokenizer

Model card Files Files and versions Community

codex-like-tokenizer

1 contributor

History: 2 commits

SaulLu's picture

add codex like tokenizer files

09e32c3 over 2 years ago

.gitattributes

1.18 kB

initial commit over 2 years ago
merges.txt

461 kB

add codex like tokenizer files over 2 years ago
special_tokens_map.json

357 Bytes

add codex like tokenizer files over 2 years ago
tokenizer.json

2.11 MB

add codex like tokenizer files over 2 years ago
tokenizer_config.json

636 Bytes

add codex like tokenizer files over 2 years ago
vocab.json

799 kB

add codex like tokenizer files over 2 years ago