NousResearch
/

Meta-Llama-3-8B-Alternate-Tokenizer

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

teknium commited on Jun 6

Commit

a0a0712

•

1 Parent(s): 9fe5e73

Update special_tokens_map.json

Files changed (1) hide show

special_tokens_map.json +1 -1

special_tokens_map.json CHANGED Viewed

@@ -1,4 +1,4 @@
 {
   "bos_token": "<|begin_of_text|>",
-  "eos_token": "<|end_of_text|>"
 }

 {
   "bos_token": "<|begin_of_text|>",
+  "eos_token": "<|im_end|>"
 }