Hugging Face's logo

baebee
/
nuph-tokenizer

Transformers
Transformers.js
tokenizers
experimental
auto tokenizer
llama
llama 2
custom code
Inference Endpoints
Model card Files Community
baebee commited on
Commit
9536ae0
•
1 Parent(s): 0244572

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -11,4 +11,5 @@ tags:
11
  - custom code
12
  ---
13
 
14
- # Experimental tokenizer
 
 
11
  - custom code
12
  ---
13
 
14
+ # Experimental tokenizer
15
+ - Derived from the LLaMa-2 tokenizer