albert-tokenizer-without-normalizer / tokenizer_config.json
SaulLu's picture
add modified albert tokenizer
67b371b
raw
history blame contribute delete
43 Bytes
{
"tokenizer_class": "AlbertTokenizer"
}