Tencent-Hunyuan-Large / special_tokens_map.json
woodchen7's picture
Upload special_tokens_map.json with huggingface_hub
9f47693 verified
raw
history blame
227 Bytes
{
"additional_special_tokens": [
"<|startoftext|>",
"<|extra_0|>",
"<|extra_4|>",
"<|extra_5|>",
"<|eos|>"
],
"bos_token": "<|startoftext|>",
"eos_token": "<|endoftext|>",
"pad_token": "<|pad|>"
}