xlsr-aiish-nomiii / added_tokens.json
susmitabhatt's picture
Upload tokenizer
90f38ab verified
raw
history blame
30 Bytes
{
"</s>": 29,
"<s>": 28
}