Commit
•
87300cd
1
Parent(s):
2fb44ad
Upload tokenizer
Browse files- vocab.json +2 -2
vocab.json
CHANGED
|
@@ -4,12 +4,12 @@
|
|
| 4 |
"0": 36,
|
| 5 |
"1": 38,
|
| 6 |
"2": 16,
|
| 7 |
-
"3":
|
| 8 |
"4": 35,
|
| 9 |
"5": 11,
|
| 10 |
"6": 0,
|
| 11 |
"7": 32,
|
| 12 |
-
"8":
|
| 13 |
"9": 25,
|
| 14 |
"[PAD]": 40,
|
| 15 |
"[UNK]": 39,
|
|
|
|
| 4 |
"0": 36,
|
| 5 |
"1": 38,
|
| 6 |
"2": 16,
|
| 7 |
+
"3": 1,
|
| 8 |
"4": 35,
|
| 9 |
"5": 11,
|
| 10 |
"6": 0,
|
| 11 |
"7": 32,
|
| 12 |
+
"8": 2,
|
| 13 |
"9": 25,
|
| 14 |
"[PAD]": 40,
|
| 15 |
"[UNK]": 39,
|