Hugging Face's logo

baebee
/
nuph-tokenizer

Transformers
Transformers.js
tokenizers
experimental
auto tokenizer
llama
llama 2
custom code
Inference Endpoints
Model card Files Community
baebee commited on
Commit
698eb08
•
1 Parent(s): 9536ae0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -12,4 +12,5 @@ tags:
12
  ---
13
 
14
  # Experimental tokenizer
15
- - Derived from the LLaMa-2 tokenizer
 
 
12
  ---
13
 
14
  # Experimental tokenizer
15
+ - Derived from the LLaMa-2 tokenizer
16
+ - Inspired by the ChatML & Zephyr tokenizers