glm-10B-chinese / added_tokens.json
sunzeyeah's picture
init
ef8d447
raw
history blame
223 Bytes
{
"<|endoftext|>": 50000,
"[SEP]": 50001,
"[CLS]": 50002,
"[MASK]": 50003,
"[UNUSED1]": 50004,
"[UNUSED2]": 50005,
"<|startofpiece|>": 50006,
"<|endofpiece|>": 50007,
"[sMASK]": 50008,
"[gMASK]": 50009
}