Adds the tokenizer configuration file (#7)
Browse files- Adds tokenizer_config.json file (eb86b9eeabbb0344e3f71f12e08d06d9e89bf914)
Co-authored-by: Lysandre <[email protected]>
- Adds tokenizer_config.json file (eb86b9eeabbb0344e3f71f12e08d06d9e89bf914)
Co-authored-by: Lysandre <[email protected]>