Locutusque
/

Llama-3-Yggdrasil-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Locutusque commited on Jun 4

Commit

3ad0409

•

1 Parent(s): f367793

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -0

tokenizer_config.json CHANGED Viewed

@@ -2052,6 +2052,7 @@
   "bos_token": "<|begin_of_text|>",
   "clean_up_tokenization_spaces": true,
   "eos_token": "<|end_of_text|>",
   "model_input_names": [
     "input_ids",
     "attention_mask"

   "bos_token": "<|begin_of_text|>",
   "clean_up_tokenization_spaces": true,
   "eos_token": "<|end_of_text|>",
+  "pad_token": "<|end_of_text|>",
   "model_input_names": [
     "input_ids",
     "attention_mask"