Hugging Face's logo

lmsys
/
vicuna-7b-v1.1

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Model card Files Community
10
TheBloke nmuendler commited on
Commit
44256c1
•
1 Parent(s): f80b1d9

Fix special tokens (otherwise model will not stop appropriately) (#1)

Browse files

- Fix special tokens (otherwise model will not stop appropriately) (8d02d19bad520816ea794b7d6967722f273e551f)


Co-authored-by: Niels <[email protected]>

Files changed (1) hide show
  1. special_tokens_map.json +3 -3
special_tokens_map.json CHANGED
@@ -1,20 +1,20 @@
1
  {
2
  "bos_token": {
3
- "content": "",
4
  "lstrip": false,
5
  "normalized": true,
6
  "rstrip": false,
7
  "single_word": false
8
  },
9
  "eos_token": {
10
- "content": "",
11
  "lstrip": false,
12
  "normalized": true,
13
  "rstrip": false,
14
  "single_word": false
15
  },
16
  "unk_token": {
17
- "content": "",
18
  "lstrip": false,
19
  "normalized": true,
20
  "rstrip": false,
 
1
  {
2
  "bos_token": {
3
+ "content": "<s>",
4
  "lstrip": false,
5
  "normalized": true,
6
  "rstrip": false,
7
  "single_word": false
8
  },
9
  "eos_token": {
10
+ "content": "</s>",
11
  "lstrip": false,
12
  "normalized": true,
13
  "rstrip": false,
14
  "single_word": false
15
  },
16
  "unk_token": {
17
+ "content": "<unk>",
18
  "lstrip": false,
19
  "normalized": true,
20
  "rstrip": false,