norbert / tokenizer_config.json

Commit History

Tokenizer config back
e33d551

Andrey Kutuzov commited on

Discarded basic tokenization to better fit our vocabulary
acc64ce

Andrey Kutuzov commited on

Original NorBERT commit
6b4e281

akutuzov commited on