Text Generation
Transformers
PyTorch
English
llama
finance
llms
text-generation-inference

Tokenizer

#2
by shahagam4 - opened

Can you please upload tokenizer-related files? Thank you. I am getting the following error.

OSError: Can't load tokenizer for 'ChanceFocus/finma-7b-nlp'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'ChanceFocus/finma-7b-nlp' is the correct path to a directory containing all relevant files for a LlamaTokenizerFast tokenizer.

ChanceFocus Asset Management (Shanghai) Company org

Absolutely, my apologies for the inconvenience. We previously stored the tokenizer in the backbone model directory, which might have led to this confusion. We will promptly upload our tokenizer and update our README and model card to rectify this issue. Please stay tuned and thank you for your patience!

Thank you.

shahagam4 changed discussion status to closed
ChanceFocus Asset Management (Shanghai) Company org

Thank you for your understanding. I'm happy to inform you that we have now updated our usage instructions and uploaded the tokenizer-related files for FinMA-7B-NLP. We have also thoroughly tested it to ensure that it works seamlessly now. We apologize for any inconvenience caused and appreciate your patience. Please feel free to give it another try. Thank you!

Sign up or log in to comment