Model Details
A tokenizer designed for the Nepali language, supporting both word and subword tokenization. Ideal for Nepali NLP tasks such as language modeling, text classification, and more, addressing the specific needs of Nepali script and grammar
Model Description
- Developed by: Universalml Inc.
- Funded by : AWS , DigitalOcean
- Language(s) (NLP): Nepali
- License: MIT
- Finetuned from model optional: microsoft/Phi-3.5-mini-instruct
Model tree for universalml/Nepali_Tokenizer
Base model
microsoft/Phi-3.5-mini-instruct